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I. INTRODUCTION 


A. BACKGROUND 


The link between intelligent behavior and mission planning and control of 
autonomous vehicles is one of the major issues in research efforts of artificial intelligence 
and robotics. It is apparent that the creation and incorporation of “intelligence” for truly 
autonomous vehicles that are able to conduct a mission fully independently requires serious 
considerations about the software architecture. One solution is the Rational Behavior 
Model (RBM), a multi-paradigm, tn-level architecture for the control of autonomous 
vehicles [Ref. 1]. The attribute “tri-level”’ 1s based on the three levels of abstraction, namely 
the strategic (top), tactical (middle), and execution (bottom) level. ‘““Multi-paradigm’’, on 
the other hand, describes the utilization of different programming languages in order to 
exploit their strengths and to avoid their weaknesses wherever it 1s appropriate. 

The RBM architecture has been implemented for the Naval Postgraduate School 
Autonomous Underwater Vehicle Model I] (NPS AUV II) and has been successfully run in 
simulation using one workstation for each level and being connected via ethernet. 

Initially, the three levels of RBM have been implemented in Prolog (strategic level), 
Classic-Ada (tactical level), and C (execution level). The hardware onboard the NPS AUV 
currently consists of two Gespac computers with an 80386/MS-DOS and a 68030/OS-9 
processor. Unfortunately, there does not exist a PC-version for Prolog that provides an 
appropriate interface to Classic-Ada. The study presented here provides one solution for 
this problem. This is, as a major part of this study, the translation from Prolog to CLIPS has 
been accomplished for the strategic level. The translated CLIPS implementation of the 
Strategic level now works with a tactical level which has been completed in Ada in another 


study [Ref. 2]. 


B. OBJECTIVES 


In this thesis, interests were focused on the implementation of the strategic level by 
rule-based programming languages and on the investigation of a translation between two 
programming languages whose production systems are based on backward and forward 
chaining, respectively, will exhibit the same behavior on mission control and execution of 
robust vehicles, such as the NPS AUV II. In other words, 1s it possible to achieve both 
logical and behavioral equivalence of two different chaining implementations for the 


strategic level? 


C. SCOPE 


This study was specifically focussed on three major tasks: 

(1) Discussing the graphical representations of rule based programming languages; in 
particular, AND/OR goal trees for a language with a backward chaining inference engine 
and State Transition Diagrams With Path Priority (STDWP) for a language with a forward 
chaining inference engine. The main emphasis is put on the discussion of STDWP since it 
was introduced newly in [Ref. 3]. 

(2) Applying both graphical representations as tools for the implementation in the 
corresponding programming language. 

(3) Investigating the logical and behavioral equivalence of the example programs and 


the CLIPS implementation for the RBM’s strategic level for the NPS AUV. 


D. ORGANIZATION 


This study contains two major parts: 

The first part covering Chapters II and III, discusses state diagrams and state tables in 
general and the background of STDWP’s. The STDWP is introduced and presented as a 
tool for graphical representation of a forward chaining rule-based system. Its terminology 
and definitions are explained as well in this context. 

The second part covering Chapter IV, applies the STDWP as a means of translating 


backward and forward chaining implementations from basic to more complicated 





examples. Finally, the translation of the RBM’s strategic level for the NPS AUV from a 
backward to a forward chaining implementation is presented. 

The summary and conclusions are made in Chapter V, where also an outlook on the 
STDWP’s general applicability is ventured and where challenges on future research are 


discussed. 


I]. STATE TABLES AND STATE DIAGRAMS IN GENERAL 


State tables and state diagrams have been mostly used in switching theory and for logic 
design to represent sequential systems, such as logic circuits. Therefore, a brief overview 
of logic circuits and of available tools for designing such circuits are presented in the 
following sections. State tables and state diagrams will be discussed in particular since they 
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constitute the background for “State Transition Diagrams with Path Priority” as will be 


shown in Chapter III. 


A. OVERVIEW 


Logic circuits are basically classified into two groups, namely combinational and 
sequential circuits. [Ref. 2] [Ref. 3] 

A combinatorial circuit is defined as a circuit whose output at any time is a function 
of its input signals without regard to previous inputs; 1.e., a domestic lighting circuit 


controlled by an ordinary tumbler switch turns the light “on” if the switch is up, it turns it 


“off” if the switch is down.! 

A sequential circuit is defined as a circuit whose output at any given time 1s determined 
by the order in which the input signals are applied; 1.e., a lighting circuit controlled by a 
cord-pull. The effect of pulling the cord depends on the state the circuit 1s currently in; if 
the light is “on” then pulling the cord will turn it “off’, if the hight is “off”, the light will be 
turned “‘on”’. 


Sequential circuits are further classified into 
(1) event-driven, 
(2) clock-driven, and 


(3) pulse-driven circuits, 


1. Combinational circuits are not further discussed in this study. 





each of which can be determined in more detail as a cyclic or an non-cyclic circuit 


depending on the fact whether the circuit returns to its initial state or not.” 


Several methods are available to design and to describe sequential circutts: 
(1) Verbally, by the means of word statements, 
(2) Diagrammatically, by the means of state diagrams, 
(3) Tabularily, by the means of state tables, and 


(4) Algebraically, by the means of Boolean statements, loosely referred to 
as Sequential equations. [Ref. 3} 

Verbal statements are subject to misinterpretation and that is why they tendentiously 
Cause ambiguity. Sonerbal statements are not a recommendable tool. A state diagram, on 
the other hand, is free of ambiguities and can be easily understood because of its clear 
representation. State tables are in general utilized to depict the sequence (also the time 
Sequence) of a circuit’s input and output. They can also be helpful to reduce the size of a 


circuit when such a reduction is possible. Sequential equations are mostly used for 


engineering purposes before the circuit 1s actually implemented. 3 


B. STATE TABLES 


The form and features of state tables vary throughout the relevant literature. State 
tables are usually applied and modified to certain requirements. However, according to 
[Ref. 3], [Ref. 4], and [Ref. 5] most state tables have the following features in common. 

A state table has as many rows as states and as many columns as possible input signals 


(or states). In each square of the table, the next state 1s entered as result of the column’s 


input applied to the state of this row." If there is no next state the intersection in the table is 


left blank. 


2. For more details it is referred to [Ref. 3], [Ref. 4], and [Ref. 5]. 

3. Tool (1) and (4) will not be discussed in more detail since they are not useful for the objectives of 
this study. 

4. Therefore, state tables are sometimes called “next-state tables” [Ref. 2] 


A simple example of a state table 1s given in TABLE 1. 


TABLE 1: AN EXAMPLE STATE TABLE 


Sal [oe [eT 





The circuit depicted by the state table in TABLE 1 issues four states, namely “A”’, “B”, 


“C”, and “D”. Possible inputs are “X,", “X>5', “X3 , and “X4". For example, statteaaams 
transitions either to state “B” if input “X>” is existent, or to state “D” if input “X3” 1s 
existent. No transitions are made from “A” if the input “X," or ““X4q”’ occurs, so there are 


no next-states in these cases. 
Additional data, such as an initial state, a final or accepting state, or a certain Output 
after a transition, may be built ina state table as well. For this study, however, the discussed 


features are satisfactory. 


C. STATE DIAGRAMS 


The information available in a state table is graphically represented in a state diagram. 


>, and input / conditions. The 


A state diagram in general consists of nodes, directed lines 
nodes represent states. The arrows link the nodes and represent the interstate transitions. An 
arrow connecting a node with itself indicates that no change of state occurs. The input / 
conditions are usually inserted above or below the arrow representing the corresponding 


transition. 


5. In the following, a directed line is referred to as an “arrow”. 


The example given in TABLE 1 is graphically displayed as a state diagram in Figure 1. 





Figure 1: State diagram derived from the state table in TABLE 1 


There is no difference between a State table and a state diagram, except for the 
different representation. A state diagram follows directly from a state table and gives a 
pictorial view of the state transitions and is very suitable for human interpretation. By the 
same token, state diagrams are often used as initial design specification of sequential 


Circuits, machines, or systems [Ref. 6]. 


Hl. THE STATE TRANSITION DIAGRAM WITH PATH PRIORITY 
(STDWP) 


A. INTRODUCTION 


A State transition diagram (STD) 1s a modeling tool for describing a time dependant 
behavior of a system. It is represented as a graph that consists of nodes, each representing 
one of the possible states of the system, and of arrows which represent the valid state 
transition among the states. A state transition occurs only in case of a detected specific 
condition. A state is defined as a set of attributes which characterizes the system at a given 
time. No knowledge of past inputs is needed at this moment to determine the further 
behavior of the system. 

The ordinary STD is extensively used as a tool of switching theory and logical design. 
In this chapter, a new extended STD 1s introduced which is called a State Transition 


Diagram With Path Priority (STDWP) 


B. DEFINITIONS AND EXAMPLES 


The notation used for conventional STD’s requires that responses, in the form of state 
transitions, are identified for all possible conditions. This may lead to states which have two 
or more successor States. To avoid nondeterminism, the conditions for each transition path 
must be mutually exclusive. For example, if a set of condition @ is needed to trigger a 
transition from state “A” to state “B’’, and another set of condition 8 causes a transition 
from state ‘‘A”’ to state “C”’, then it must be true that anNB = ©. 

Unfortunately, the approach adopted by conventional STD’s, in order to avoid 
nondeterminism, limits its applicability to real world problems. In [Ref. 7], Kwak et alteri 
presented a new approach to relieve this limitation. It is called a State Transition Diagram 
With Path Priority (STDWP). A STDWP has all the characteristics of a conventional STD. 

However, unlike a STD, a STDWP allows a state to have two or more successor states 
with non-mutually exclusive state transition conditions. For example, if a set of condition 


is needed to trigger a transition from state “‘A”’ to state ‘““‘B”’, and another set of condition 


8 causes a transition from state “A” to state “C”, then either aN B = © or aNB#OQ is 
allowed. The latter case is an unique characteristic of a STDWP. Additionally, in a 
STDWP, nondeterminism caused by ANB #2, is taken care of by priorities among 
possible non-unique state transition paths. That is, if a specific condition makes multiple 
State transition paths eligible, then only one state transition path with the highest path 


priority will be selected and the corresponding state transition will be made. 


Definiton (1): A State Transition Diagram With Path Priority (STDWP) has the 
characteristics of a conventional STD and allows for each state two or more successor states 
with non-mutually exclusive state transition conditions. Non-mutually exclusive state 


transitions issue path priorities, such that only one transition will actually be made. 


A portion of aSTDWP is shown in Figure 2. There are four states, ““A’’, “B”’, “C’’, and 
“D”. Suppose, “A” is the current state, then “B”, “C”, and ‘“‘D” are successor states. The 
State transition conditions are shown as combinations of “X”, “Y”, and “Z’. The path 
priority for the appropriate state transition conditions is also shown with numerical values 
for “p”, namely “p=1”, “p=2”, and “p=3” where a bigger number means a higher priority. 
For example, the state transition conditions from “A” to “D” are “X” or “Y” with path 
priority “‘p=2”. Therefore, there are three state transition paths which have non-mutually 
exclusive state transition conditions. For example, if conuition “X” is currently met, all 
three state transition paths become eligible. However, only one state transition path is 


actually made from “A” to “C’’, that is the path with the highest path priority, in this case 


the transition from “A” to “C’. This fact is documented by a competing arc which connects 


the relevant state transition arrows. 


Definiton (2): If a state in a STDWP has multiple successor states with non-mutually 
exclusive state transition conditions, then a competing arc indicates the competing 


relationship among these successor States. 





Figure 2: A portion of a State Transition Diagram With Path Priority 


Therefore, a state transition ina STDWP is composed of two stages of operation: 

First, activate possible state transition paths. In the previous example, all three state 
transition paths were activated with condition “X”’. 

Second, execute the state transition which has the highest path priority among 
activated state transition paths. This sequence of two stages is called the activation stage 
and execution Stage, respectively. 

In Table 2, for all possible combinations of “xX”, “Y”, and “Z” conditions, the 
corresponding state transitions are tabulated with the two state operations. The numerical 
entries in the left column indicate if the corresponding condition(s) exist(s) or not. “0” 
means absence of the corresponding condition, and “1” means its existence. The alphabetic 


entries in the other columns show either activated state transitions (see center column) or 
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executed state transitions (see nght column); 1.e., “AB” in the right column means an actual 


state transition from “‘A’”’ to ““B” if the condition combinations “X”’ or “XZ”’ are existent. 


TABLE 2: Transition Table for STDWP in Figure 2 


Condition XYZ | Activated Transition | Executed Transition 


60 
a ae eee es 
a 
on 
a 
a 
a CS 


Another major difference to conventional STD’s is an implicit backtracking feature 


















built in a STDWP. In other words, if the available input does not satisfy any of the explicit 
state transition conditions from the current state, then backtracking will be initiated. That 
is, the current state is changed to that previous state which has multiple successor states and 


is closest to the current state. This discovery leads to the following definitions. 


Definiton (3): A branching state is a state with multiple successor states. If a 
branching state 1s the first state that can be arrived by traversing against the normal state 
transition direction, then it 1s called a closest previous branching state. However, a 


branching state itself cannot be a closest previous branching state. 


Definiton (4): A branching state may have a competing arc and/or path priorities if 


there is a non-disjoint state transition condition. 


1] 


Definiton (5): A state with multiple previous States is called a merging State and has 
no closest previous branching state. Successor states of a merging state also have no closest 
previous branching state unless one of the successor states becomes a branching state. A 


Starting state is treated as a merging state. 


Therefore, if any condition of all possible state transitions cannot be met, then the state 
changes to the closest previous branching state. This transition is called backtracking 

For example, Figure 3 shows a STDWP with six different states. Note, that the 
STDWYP in this figure has disjoint state transition conditions. Thus, there are no competing 
arc and no path priorities. “A” is the closest previous branching state for state “B”, “C”, 


“D”, and “E”’. “‘F’, however, does not have a closest previous branching state since it 1s a 


KC fw 
yt (D}—+(E) y3 


Figure 3: A STDWP with six states 
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merging state. The backtracking paths for each state may be explicitly drawn in a STDWP 


as shown in Figure 4, but are preferably not included to keep the drawing simple. 





Figure 4: A STDWP showing implicit backtracking paths 


One possible scenario of state transitions is shown in Table 3. Since the required state 
transition condition is available at the right time a sequence of state transitions from “‘A”’ to 


“F” via “B” and “C” can be conducted without any backtracking. 


TABLE 3: Scenario without backtracking 


See a 
Ea ae ae 


Another scenario 1s shown in Table 4. After the state transition from ““A”’ to “B” and 






from ““B” to “C” are carried out, input x3 1s not available at time tz. At this moment, rather 


than stopping and waiting for an external input indefinitely, backtracking is started to the 


closest previous branching state, which is state “A’’. Fortunately, the external input yj is 


available. Thus, the state transition to “D” is possible and the path eventually arrives at ‘“‘F”’. 


However, if the external input y; were not available, then no further state transition would 


be done and state ““F’’ would never be reached. 


TABLE 4: Scenario with backtracking 


Current State PEP aE Oe Next State 





In the above discussion, only one State transition condition was utilized for each state, 
and all state transition conditions were unique. This setup does not imply a limitation of 


STDWP; also was t; introduced just for demonstration purposes. Like common STD’s 


STDWP is capable of representing both, synchronous and asynchronous states. 

A STDWP can also be organized as a multi-level STD [Ref. 8] where an individual 
state of a higher-level diagram can encapsulate a lower-level diagram. Then the final 
state(s) in the lower-level diagram is(are) identical to the exit conditions of the higher-level 
state. This decomposition may be recursively applied to give order and understandability 
to an otherwise complex diagram, the decomposition represents a standard approach to the 


design and analysis of complex, state-based systems. 


C. SIGNIFICANCE AND APPLICABILITY 

The introduction of STDWP’s facilitates the graphical representation of a new class of 
problems. In [Ref. 9] and [Ref. 10] STDWP’s were applied to represent and explain high- 
level control of the NPS AUV-II graphically. Another application of a STDWP is the 
graphical representation of a forward chaining rule-based system. Such a system operates 


in two steps, rule activation and rule-firing [Ref. 11]. This exactly corresponds to the 
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STDWP’s activation and execution stages. Thus, competing behaviors among rules in the 
rule agenda of a forward chaining rule-based system can be graphically depicted, and rule- 
firing can be graphically modeled, too. 

As a consequence, STDWP’s build a bridge between a forward chaining rule-based 
system as domain of Artificial Intelligence and a control based system represented by a 
conventional STD. Practical engineers with background of STD’s and with a little 
knowledge of STDWP’s can easily extend this idea to a high-level control of complex 
autonomous robots without learning an entirely new forward changing rule-based system. 
This advantage turns out to be very beneficial for the control of autonomous robots, 
because rule-based control of robot systems is very promising for design and coding of 
mission logic, as it was reported in the Rational Behavior Model software control 
architecture research of [Ref. 12] and [Ref. 9]. The impact of STDWP’s is just unfolding, 
their application yet to be discovered for the future. 

The following sections of this study show the application of STDWP’s in general and 
for RBM software control architecture in particular. The RBM is mainly designed for 


control of a real-time autonomous agent, and will be briefly described later. 


1 


IV. APPLICATIONS OF THE STDWP 


A. INTRODUCTION 


In this chapter, the very basic structures, ““AND-Relationship” and “OR- 
Relationship”, that may be found in any portion of a Prolog program are discussed and 
depicted by STDWP structures. Implementations 1n CLIPS are then derived from these 
STDWYP structures. In order to show how this translation pattern can be applied to more 
complex structures, two small Prolog programs are introduced later. They are first 
displayed by an AND/OR goal tree (whose definition will follow in the next section) and 
then translated in a STDWP. Finally, the STDWP is implemented in CLIPS code. 

Either program follows a different approach of implementation. As it will be shown, 
the second implementation predominates the previous one by its assets, although both 
programs are equivalent to the initial Prolog code, in particular in regard to logic and 
behavior. 

The final section of this chapter briefly introduces the Rational Behavior Model 
(RBM) and its strategic level, one of three main components of the RBM. The strategic 
level is represented graphically by an AND/OR goal tree and by a STDWP. For either 


representation the corresponding implementation is explained and presented. 


B. BASIC STRUCTURES 


I. AND-Relationship 

A simple example of a Prolog rule and its notation as an AND/OR goal tree is 
shown on the left hand side of Figure 5. An AND/OR goal tree is defined as follows: 

“An AND/OR goal tree is a graphical representation of AND/OR goal 
decomposition, with the root node representing the root goal, the leaf nodes representing 
the primitive goals, all other nodes representing intermediate goals subject to further 
decomposition, and the connecting arcs representing the logical relationship between 


subgoals and the goal from which they were decomposed.” [Ref. 9] 





In the given example, “A” is the goal, “B” and “C” are subgoals. Both subgoals 
have to be satisfied to satisfy the goal “A”. This relationship is graphically shown in an 
AND/OR goal tree by introducing a parent node “A”’ and two children nodes, “B” and “C”’. 
The “AND-Relationship” between “B” and “‘C” is depicted with an arc connecting the 
adjacent branches. The AND/OR goal tree which is equivalent to the Prolog rule 1s now 


translated ina STDWP. The result is shown on the right hand side of Figure 5. 


A:- B,C. 


initial-fact fact B fact C a 
, (che) » = > Ce) P(ake) 





Figure 5: Example of an ““AND-Relationship”’ 


’ 


Specifically, the “A” node of the AND/OR goal tree corresponds to the ““A done’ 
state in the STDWP, and the “B” and “C” nodes are equivalent to the “state B”’ and “state 
C”’ states, respectively. The “A start” state is a special state which 1s introduced to show the 
current mode of an operation of a STDWP and to signal that the STDWP is trying to 
achieve goal “A”. Only when the two successor states are satisfied, the ““A done” state can 
be reached. The “A done”’ state itself signals the achievement and completion of goal “A”. 


The previous discussion 1s tabulated in Table 5: 


TABLE 5: Correspondence of nodes and states 


ee ae 








State C 





1} 


In CLIPS, the states of a STDWP are implemented by the deftemplate construct. 
For our example, the deftemplate construct looks as follows: 


(deftemplate rule-A 
(field state 
(type SYMBOL) 
(allowed-symbols_ start B C done))) 


The deftemplate construct in CLIPS actually defines a group of related facts, in 
this case all possible states of rule “A”. These facts will be used in CLIPS to control the 
flow in the STDWP. Thus, the equivalent CLIPS code to the given Prolog rule looks as 


shown in Figure 6. 


(deftemplate rule-A 
a d state 
Ge SYMBOL) 
(allowed- Sate Stare” sb. ©. =doVe))) 


(defrule start-program corresponding notation in the STDWE. 


7x <= (inital mack) 

=> initial-fact 
(retract ?x) —> 
(assert (rule-A (state start) )) 


(defrule rule-A-state-B 
7h <= (rule AN stace Scane)) fact B 
(Face ©) > (Hat 


(retract. .7) 
(assert (rule-A (state B)))) 


(defrule rule-A-state-C fact C 
?x <- (rule-A (state B)) act 
(face iC) 

=> 


{retrace 3x) 
(assert (rule-A (state €))]}4 


(defrule rule-A-state-done A 
?x <- (rule-A (state C)) aane 


=> 


=> 
(retract ?x) 
(assert (rule-A (state done))) 





Figure 6: CLIPS code for the ““AND-Relationship” shown in Figure 5 
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2. OR-Relationship 

A Prolog example showing “OR-Relationship” and its AND/OR goal tree are 
shown on the left hand side of Figure 7. Goal “A” can be reached by either subgoal, “B” or 
“C”. Rule “A :- B.” takes precedence over “‘A :- C.”’ because of the textual order of the rules. 

After translating the corresponding AND/OR goal tree in a STDWP two branches 
are obtained, both of which start at the state “A start” which is a branching state and end in 
the merging state “A done’. Note that there is a competing arc between the two branches 
in the STDWP to emphasize the “OR-Relationship” with a non-disjoint state transition 
condition. The upper branch corresponds to the rule with higher priority, the lower branch 
to the rule with lower priority, respectively. This fact is shown with the path priorities “O” 
aia 

The reason is as follows: Two Prolog rules with the same goal participate in an 


‘“OR-Relationship” and have an implicit order. The corresponding AND/OR goal tree also 


has the same implicit order; i.e., from left to right.? Thus, the upper branch of the STD WP 
corresponds to the left branch of the AND/OR goal tree and has a higher priority than the 


1. Since CLIPS assigns a salience of “0” to any rule per se this study follows this automatism and 
assigns a salience of ‘*-1” to the lower branch; the next branch would obtain ‘‘-2”, and so forth. 

2. Therefore, an AND/OR goal tree is equivalent to an AND/OR tree with a depth-first-goal tra- 
verser. 


lower branch. In order to satisfy this fact, the saliences “OQ” and “‘-1” are assigned to the 


appropriate branches. 


A:- B. fact Bp =0 (3) 
A:- C. ee Oe 


initial-fact A 
done 
© ~My 


Figure 7: Example of an “OR-Relationship”’ with single states in each branch 





Similar to the example for an “AND-Relationship”’, a deftemplate construct is 
built with the states “‘start’, “B”, “C’, and “done” referring to the states in the STDWP. 
However, an additional deftemplate construct 1s necessary for three reasons caused by the 


implementation: 
(1) to facilitate the required backtracking capability, 
(2) to avoid confusion with equal states in different branches, and 


(3) to identify the paths associated with “OR-Relationship”. 
This deftemplate construct may be called “A-branches” and shall represent the 
upper path by “branch A-1”, and the lower branch by “‘branch A-2”. Thus, the two 


deftemplate’s are constructed and will look as follows: 


(deftemplate rule-A 
(field state 
(type SYMBOL) 
(allowed-symbols_ start B C done))) 
(deftemplate A-branches 
(field branch 
(type SYMBOL) 
(allowed-symbols A-1 A-2 ))) 


As mentioned earlier, the “‘A start’ state in the STDWP includes the initialization 


of an operation mode. In this case, the ‘‘A start” state acts as a “traffic control state’’. In the 
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case of an “AND-Relationship” the traffic control functionality is not necessary since there 
exists only one path in the STDWP and backtracking is not an issue at all since there is no 
closest previous branching state. However, if there are different branches as in an “OR- 
Relationship”, then we need to provide traffic rules to control the backtracking path to the 
closest previous branching state and to start a new branch. That is (see Figure 8), if the 
transition from ““B” to “A done” fails because “fact B” is not true or not available, then the 
state ““A done” will not be reached by the upper branch. Instead, the lower branch is 
activated by the traffic rule “A-branch-2-start” (after backtracking to the closest previous 
branching state “‘A start’) which awaits the failure of the upper branch and asserts the fact 
“(branch A-2)’, so that the lower branch is tried. However, this attempt could also fail, if 
“fact C” does not exist. 

If a branch fails, the fact-list will still contain the traffic control facts asserted by 
the traffic rules and one of the facts that has been most recently asserted by one of the rules 
in this branch. This circumstance could possibly cause confusion with repeated states or 
similar constructs within the STDWP. To avoid such an insufficiency an additional traffic 
rule called ‘‘clean-up” takes facts left over from the last failed branch off the fact-list and 


cleans it up for later assertions. 


Ze 


(deftemplate rule-A 
(field state 
yee SYMBOL) 
(allowed-symbols start B €¢ done) )) 


(deftemplate A-branches 
(field branch 
es SYMBOL) 
(allowed-symbols A-1l A-2))) 


(defrule start-program 


xe <= 1initial-fact) initial-fact 
=> 
(retract ?x) 


(assert (rule-A (state start))) 


‘ 


(defrule A-branch-1l-start 
?x <- (rule-A (state start) ) 
=> 
(retract. 2) 
(assert (A-branches (branch A-1)))) 


(defrule A-branch-2-start 
(declare (salience -1)) 
2x <- (A-branches (branch A-1)) 
OY aa, Peak Stace.) 7 


(retract ?x) 
(retract ?yv) 
(assert (A-branches (branch A-2)))) 


(defrule A-branches-clean-up 
(declare (salience -2)) 
?x <- (A-branches (branch A-2)) 
2?y <- (rule-A (state ?)) 


== 
(Fetract +7) 
(retrace. 7y) 

eS ae ae a a a A=l=branciae oe 

(detrule A-branch-1]-stare—B fact B 
(A-branches (branch A-1)) State 
(fact. B) B 

= 


(assert (rule-A (state B))) 


(defrule A-branch-l-state-done 

?x <- (A-branches (branch A-1)) A 
ey <="(rule-s (state B)) done 
(retract ?x) 


(Lebract. 2) 
(assert (rule-A (state done))) 


mmm ww www wee wwe ww we ww we ww ww we we ww ww we we we ww we we we wwe ie i ie i ei 


(defrule A-branch-2-state-C 


(A-branches (branch A-2)) fact C 
(fact. C) (ey 
=> 
(assert (rule-A (state C))) 
(defrule A-branch-2-state-done 
72% <= (A=branches (branch A-Z)) 
E ?y <- (rule-A (state C)) 
=> done 
(retract 23) 


(retract 7y> 
(assert (rule-A (state done))) 


Figure 8: CLIPS code for the “OR-relationship” in Figure 7 
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C. A MORE COMPLICATED PROBLEM 


Il. Implementation 
In order to show how basic structures are combined in a STDWP and how a given 
construct is implemented in CLIPS, the following steps are shown in the following. 
First, a simple, RBM’s strategic-level alike Prolog program is introduced. An 
AND/OR goal tree is then constructed after this program which will be followed by the 


transition to a STDWP. Then the equivalent CLIPS code 1s produced. 


(1) The simple Prolog program is shown in Figure 9. 


0 


“tM TC) 
7 


TOMOOMOE 


A: 
B :- 
B :- 
C :- 
C :- 
C :- 
D -- 
D -- 





Figure 9: A simple Prolog program 


(2) The corresponding AND/OR goal tree is shown in Figure 10. 










2 (C) os 
J 7S 


NM © QOO QO © © @ 
OPO © @®© @ 


Figure 10: AND/OR goal tree for the Prolog example in Figure 9 
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(3) Similar to the example for an AND-Relationship, rule “A” of the Prolog 
code is represented in a STDWP as shown in Figure 11. This construct corresponds to the 
top level of the AND/OR goal tree shown in Figure 10. The states “B”, “C’, and “D”, 
however, encapsulate lower-level STDWP’s. In this case we talk about a multi-level 


STDWP. 


initial-fact fact B fact C fact D x 
+ (eh (BCD) 


Figure 11: Multi-level STDWP with encapsulated states 


(4) The multi-level STDWP shown in Figure 11 1s explicitly expanded in 


Figure 12. 3 





Figure 12: Complete STDWP for the Prolog example in Figure 9 


It can be easily inferred from the Prolog code that the subgoals “E’’, “F’’, “G”’, and 


‘‘H” are facts since there is no rule corresponding to those subgoals. Therefore these facts 


3. In order to simplify the drawing, state transition conditions are not shown. However, path priori- 
ties and competing arcs are drawn for clarity. 
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are represented as leaves in the AND/OR goal tree. At least one fact, “E” or “F’’, is required 
to reach the goal “B” and “C’, respectively; and either condition “G” or “H”’ satisfies the 
goal “D”’. Therefore, any combination of states (“E” or “F’’, and “‘G” or “H”) eventually 
facilitates a path to the goal “A” successfully (see Figure 12 and also Figure 10). 

The state transition table for the STDWP of Figure 12 is shown in Table 6. It 
tabulates the inputs which are required to reach the goal state “A done”. 


TABLE 6: State transition table for the STDWP 





2. Testing 


Two test cases may be used to support the above observation and to illustrate how 
the CLIPS program shown in APPENDIX A determines the path through the STDWP. The 
first test case provides “fact E” and “fact H” to the STDWP. This will furnish the STDWP 
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to reach the state “A done’. As expected, the corresponding CLIPS code will reach the state 


‘‘A done” as shown in Figure 13. 


PATH through STDWP 


A-start; 

B-start (branch B-l 

D-start (branch D-2 

E-state; B-done; 

C-start (branch C-1l 

D-start (branch D-2 
Cc 
2 


je D=Start- (branch. D-1)>- =~ branch D=l--tai Nive. 
)}; H-state; D-done; 


Jj: D-start (branch D-1)>-* branch D=-1] failures. 
); H-state; D-done; 

E-state:> * branch C-1 failure * 

C=-start: (branch C=-2); D=start (branch D=1)>+ * branch D=1. failures. 

D-start (branch D-2); H-state; D-done; 

* bYanen. C=2 sfaiivre- = 

C-start (branch C-3); E-state; C-done; 

D-start (branch D-1) 

D-start (branch D-2) 

A-done 


prance: i= stad bie: s* 
; H-state; D-done; 


= Successful termination: 





Figure 13: Output of first test case 


In the second test case, “fact E’’ and “fact F’ are provided for the CLIPS code. 
These two states are not sufficient to furnish the STDWP to reach state “‘A done” instead, 
it fails. This behavior can be observed in Figure 14 which shows the output of a sample run 


with tact E° and fact F . 


PATH through STDWP 


A-start; 

B=-start (branch B-1): D=start (branch D-1); * branch D=1 failures 
D-start (branch D-2);: * No D-branch successful * 

* Dranen. 5-1-1 ad ur ot 

B-start (branch B-2); F-state; B-done; 
C-start (branch C-1); D-start (branch D-1); * branch D-1 failure * 
D=start  (branen D=-2)'>~" No D-=branen suecesstul * 

*Dranch C=-l--tarlure * 
C-start (branch C-2)> D=-start (branch D=-1):- * branch D-1 failueome 
D-start (branch D=2)- * No D-branch successful \* 

* i pranch C=2. failure. * 

C-start (branch C-3); E-state; C-done; 

D=stare “(branen D-1) +*2 branch D=1 failure * 

D=start (branch D-2); * No D-branch successful * 


* Premature Termination, no success! * 





Figure 14: Output of second test case 
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3. Assessment of the Behavior 


The CLIPS program was tested for any conceivable scenario and proved the 
correct behavior by producing the expected sequence of states in the STDWP. This 
sequence is equivalent to the goal activation achieved by the original Prolog code shown in 
Figure 9. 

Apparently, this behavior is satisfactory - but only for a problems of the given 


kind. The reason, why it behaves correctly is, that the number of branches in the “OR- 


Relationships”, that occur in the “second level”, 1s limited 4. 1.e., rule “D” consists of two 
branches, each of which holding just one state, namely “G” and “H”’. After the failure of 
the branch with salience “O” only one choice 1s left, namely the other branch with salience 
“1, 

If there were more than two branches with multiple states, then the 
implementation shown in the previous section would quickly reach its boundaries. In this 
case, the system should encounter a newly competing situation, that is, a competition 
between all branches which have not failed yet. And besides that, it must be assured that 
the recently failed branch does not participate in any other branch competitions. 

Combined with this study, the attempt has been made to implement “OR-OR- 
Relationships” by following the translation pattern in the previous section. But it turned 
out, that the program actually conducts a sequential run through the eligible states 
regardless to the given saliences. And this seems to be inevitable, due to rule firing control 
and salience management. Furthermore, the number of traffic rules increased enormously, 
such that the portion of traffic, clean-up, and control rules shared almost thirty percent of 
the entire program. 

These crucial drawbacks were the motivation for a different implementation 


approach. It is being presented in the following section. 


4. An “OR-Relationship” which is itself a portion of another “OR-Relationship’s” construct may be 
called “OR-OR-Relationship” in the following. 
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D. A PROBLEM WITH ‘“SOR-OR-RELATIONSHIPS” 


1. Introduction of the Problem 
The system to be discussed in this section is shown in its Prolog version in Figure 
15, its corresponding STDWP in Figure 16, and accordingly, the CLIPS code may be found 
in APPENDIX B. The AND/OR Goal Tree is neglected in this context, since it is not 


important for the further discussion. 


w 


SOW 


~~ 


pont 5 4 Peed pened 
s eS e 


ee 


eile 
:- ALPHA, ALPHAI. 
:- BETA, BETA]. 
> GAMMA, GAMMAIl. 


A: 
A: 
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Be 
Be 
Be 
“x 
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iy 





Figure 15: A simple Prolog program 


Four levels of relationships are joint together in this system. On the first level, an 
‘“‘OR-Relationship” is given by three rules of “A”, each of which containing an “AND- 
Relationship” that is to be considered on the second level. A closer look to the right side of 
the Prolog rules makes clear that only the first rule with goal “A” contains a further level, 
thatis rule “A:- B, B1.” by the subgoal “B”. The goal ““B’’, on the other hand, can be reached 
by three alternative rules. Again, this 1s considered to be an “OR-Relationship’’, but now on 
the third level. The first and the third rule of “B” contain ““AND-Relationships”’, where the 
second rule is satisfied by subgoal ““Y’’, which leads also to an “OR-Relationship”, namely 
to the three alternative rules of ““Y”. With this construct, the fourth level is finally reached. 
To be consistent and complete, a fifth level will be entered by the ““AND-Relationships” of 
the nght hand sides of every ““Y” rule. 

Such a joint construct may be called an ‘““OR-AND-OR-OR-Relationship”. The 


fifth level, given by the “AND-Relationships” for the alternative goals ““Y’’, can be 
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neglected. This is, because an extra “AND-Relationship” does not require additional traffic 


rules; more explanations will be given in the next section. 


t= 
eS 
a 
ics 
= 
& 





Figure 16: STDWP corresponding to the Prolog code in Figure 15 


The derived STDWP is shown in Figure 16. It consists of three ““A-branches”’ 
leaving the branching state “‘A start’’, three ““B-branches”’ starting from “‘B start’, and three 
““Y-branches”’ leaving state “‘Y start’, each of which holding multiple states in this branch. 
Following the definitions of a STDWP, the upper branches have higher priority over lower 
branches, indicated by numbers (in the diagram of Figure 16 drawn close to the transition 
arrows). The transition conditions are named after the states. I.e., state “X” requires the 
transition condition “(condition X)’, “B start” may only be reached, if “‘(condition B)”’ is 
available. These transition conditions are provided in the same fashion in the CLIPS code 
which may be found in APPENDX B. To keep the drawing simple, the transition conditions 


are not shown in Figure 16, as well as the backtracking paths. 
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2. Implementation 


The most difficult part of the implementation of the STDWP displayed in Figure 
16 in CLIPS was twofold: 


(1) After a failure of a transition, the correct backtracking to the closest 
previous branching state needs to be assured. In an “OR-OR-Relationship”, there are two 
branching states which are both acting as closest previous branching states. If a branch fails 
in the second level, then backtracking to the closest previous branching state of the first 
level has to be avoided. This means, that the STDWP’s construct outside of the current 
‘‘OR-Relationship” has to be “*hidden” of any possible access. To provide this feature, a 
“status” field with a “hide” and “reveal” slot is added to each template defining an “OR- 


Relationship” in CLIPS (an example will be given shortly). 


(2) After backtracking occurred, the failed branch has to be excluded from 
any new competition among the branches which leave this closest previous branching State. 
This feature is ensured by retracting the transition condition which enabled the system to 
try the branch which turned out to fail; 1.e., if the “X-branch” fails in the ““B” construct, then 
the system is backtracking to “B-start’’. At the same time, “(condition X)” is retracted from 
the database so that the “X-branch” cannot compete anymore with the remaining and 
eligible branches “Y-branch” and “Z-branch”’. 

Besides the “hide” and “reveal” slots, two more slots have been added to the 
“status” field of the CLIPS templates, namely ‘‘failed”’ and ‘“‘succeeded”’. The slot “failed” 
1s necessary to make sure that the failed partial construct of the STDWP is not eligible 
anymore. This will be the case when the system has tried all eligible transitions in this 
portion of the STDWP and has not succeed. The slot “succeeded”’ is used for the other, the 
positive case and for “OR-AND-Relationship” constructs. State transitions, following an 
‘“OR-Relationship” after a “done” state have to be prevented from backtracking to the 
Closest previous branching state of the successful “OR-Relationship”. In the case of a 


transition failure in the “AND-Relationship”, the system must backtrack to the prior closest 
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previous branching state. I.e., in the system introduced in this section, state “B1” follows 
state ““B-done” which is the final state of the “OR-Relationship” construct for “B’’. If the 
transition to state “B1” fails, then the responsible closest previous branching state will be 
state ““A-start”, and not “B-start”. This confusion is avoided by the “succeeded” slot in 
‘“deftemplate B”’, such that the system cannot start any transitions within the “B” construct 
again. 

As an example, the CLIPS’s deftemplate construct for the “OR-Relationship” of 
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goal “A” is shown in the following to complete the previous explanations (see also 
APPENDIX B). Note that a deftemplate A-branches as it was introduced in section IV.C. 


is not required any more. 


(deftemplate A 
(field state 
(type SYMBOL) 
(allowed-symbols start B BI C Cl D D1 done)) 


(field status 
(type SYMBOL) 
(allowed-symbols reveal hide succeeded failed))) 


Backtracking comes into play when a transition failed to be executed. In order to 
ensure that the backtracking path reaches the responsible closest previous branching state, 
every branch in the STDWP has to be furnished with a traffic rule; 1.e., the traffic rule for 
the ““X-branch” within the “B” construct is “X-failure”. This rule controls the backtracking 
traffic from all states in this branch to state “B-start” which is the responsible state. At this 
point, the traffic rule “B-failure” comes into action. It activates all remaining and eligible 
transitions for another competition. As expected, the state transition with the highest 


priority will be executed then. 


3. Testing the Behavior 
The system as it was introduced above is started by the CLIPS-internal “‘initial- 
fact’ which can be accomplished automatically by the “(reset)” command.> From here, the 


5. For complete and further syntax it is referred to [Ref. 11]. 
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system is going through the states that can be reached by the given transition conditions. 
These conditions may be added to the CLIPS’s database either by a batch file or by 
asserting the conditions manually. 

Two test cases may illustrate the system’s behavior implemented by the code as 
shown in APPENDIX B. They are shown in Figure 17 and 18. 

The output shows the path through the STDWP, including the states reached by 
backtracking. These states are followed by a *... failure * message since a failure 1s the only 
cause for a backtracking path. 

In the first case, the following conditional scenario is available in the CLIPS 
database: (condition A), (condition B), (condition Y), (condition Z), (condition ALPHA), 
(condition GAMMA), (condition D), and (condition D1). The program’s output is shown 
in Figure 17. 


PATH through STDWP 


A Start; 

B-state; Y-state; 

ALPHA-state; * branch Y-1 failure *; Y-state; 
GAMMASstate; * branch Y-3 failure *; Y-state; 
* branch B-2 failure *; B-state; 

Z-State; * branch B-3 failure *; B-state 

* branch A-1! failure *; A-state 

D-state; D1-state; 

A-done; 


* Successful termination * 





Figure 17: Output of the first test case 


After starting the system and reaching state “B-start’’, only two state transitions 
are activated due to (condition Y) and (condition Z). The transition to ““Y-start” is executed 
because of its higher priority. Again, just two transition activations are eligible, caused by 
(condition ALPHA) and (condition GAMMA). Both branches will fail since none of the 
further transition conditions are met. Thus, in both cases the system is backtracking to state 


““Y-Start’” causing itself backtracking to state “B-start’”. The only eligible, activated, and 


OZ 


2 


executed transition to state ““Z” is being made, but is backtracking to state “B-start’ 
afterwards since (condition Z1) is not available. This causes backtracking to state “A-start”’ 
because all branches in the ““B” construct failed. From this point, the final state transitions 
to state “A-done”’ are conducted via state ““D” and “D1”. 

In the second test case, the scenario differs from the first one by the following 
conditions: Instead of (condition GAMMA), the database includes (condition BETA) and 
(condition BETA1); additionally (condition B1). The output looks as shown in Figure 18. 


PATH through STDWP 


A Start; 

B-state; Y-state; 

ALPHA-state; * branch Y-1 failure *; Y-state; 
BETA-state; BETA 1-state; 

Y-done; B-done; B1-state; 

A-done; 


* Successful termination * 





Figure 18: Output of the second test case 


In this case, the correct behavior of the ““OR-AND-OR-OR-Relationship” of the 
given STDWP was tested. The conducted path is shown in Figure 18 and may not require 
further explanations. 

Almost all conceivable scenarios have been tested. The system as it 1s 
implemented by CLIPS in APPENDIX B behaved in the same manner as it would do in the 
Prolog version. This proves empirically the logical and the behavioral equivalence between 


both implementations. 
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E. THE STRATEGIC LEVEL OF THE RATIONAL BEHAVIOR 
MODEL 


1. Introduction of the Rational Behavior Model 


The Rational Behavior Model (RBM) is a tri-level software control architecture 
for autonomous Vehicles. It 1s composed of a strategic, a tactical, and an execution level. 
The strategic level mainly consists of goals which are to be achieved by an autonomous 
robot vehicle under control of RBM. These goals have to be achieved in a certain sequence 
depending on external (= world) and internal (= vehicle) events to accomplish a given 
mission. In order to exhibit coherently intelligent behavior globally, some means of 
understanding and memorizing external and internal events are required by the control 
architecture. Otherwise, globally intelligent behaviors cannot be achieved by an 
autonomous robot [Ref. 13]. In RBM, the tasks of understanding and memorizing are 
performed by the tactical level [Ref. 14]. Thus, the strategic level is free from processing 
Or memorizing external or internal events directly. This arrangement reduces the 
complexity of the strategic level by a major portion; in particular, the strategic level does 
not need any state memory associated with the external world or the control of the robot. 
Instead, it queries the tactical level, whenever it 1s appropriate. Inferring the returned values 
of the predicate queries, the strategic level determines next which goal has to be activated 
at this moment. Specifically, a goal activation means a behavior activation request to the 


tactical level. Once the requested behavior is completed by the tactical level in conjunction 


with the execution level, then the goal is achieved.® In this way, goals in the strategic level 
directly affect the behavior of the physical robot under control. 

Since the strategic level purely operates by predicate queries and goals, a rule- 
based programming language is the best choice for implementation. Fundamentally, there 


are two ways of implementing rule-based programming, these are backward chaining and 


6. The execution level is the lowest level in RBM. It directly handles the vehicle’s hardware. Thus, 
the execution level is mainly composed of various conventional control loops and device drivers. 
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forward chaining. Both are equivalent in the sense of pure logical power. They are merely 
different in syntactical perspective. However, one implementation with one chaining 
direction may be more efficient than the other. In spite of this well known fact, a translation 


from one chaining implementation of the strategic level in RBM to the other is not trivial. 


The reason is due to the fact, that a sequence of logic resolution steps 1s not unique.’ In 
other words, two different chaining implementations may produce two different paths of 
goal activation and execution during chaining. This means that the two implementations 
could make the vehicle behave totally differently even though they are logically equivalent. 
However, in robot control, the sequence of behavior matters. For example, a final goal 
cannot be achieved without achieving an intermediate goal. In other words, two different 
implementations fan the strategic level of RBM have to be able to produce an identical 
sequence of goal activations. This is an unique constraint of equivalence of the strategic 
level of RBM. 

The first instance of the strategic level of RBM [Ref. 14] was implemented in 
Prolog which was used as a backward chaining rule-based programming language. This led 
to another implementation in Prolog [Ref. 15]. Both implementations have been established 
for the Adaptive Suspension Vehicle (ASV) [Ref. 16]. Later, the strategic level of the Naval 
Postgraduate School Autonomous Underwater Vehicle Model HW (NPS AUV) [Ref. 9] was 
also implemented 1n Prolog (see APPENDIX C). 

It is not surprising that Prolog served as programming language for all these 
implementations. The reason is that goals in robot vehicle control tend to be related in 
hierarchical order. For example, ‘“‘execute-auv-mission” is a top goal which can be 
immediately decomposed into subgoals corresponding to submissions of the entire mission. 
A hierarchical organization composed of a top goal, some sub-goals, some sub-sub-goals, 
etc. can be easily expressed in Prolog because of its declarative nature. Moreover, Prolog’s 


inference engine with its depth-first-search strategy forces the rule firing and conflict 


7. Chaining is known to be a special case of resolution. 
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resolution to follow the textual order of the Prolog rules. Therefore, multiple subgoals that 
participate in an “OR-Relationship” among each other can be easily priontized by the 
textual order of the Prolog rules. In this way, the strategic level can be “naturally” declared 
in Prolog, and the desired sequence of goal activations is evidently produced by Prolog’s 
inference engine. 

The forward chaining implementation of the strategic level, however, has been 
delayed until STDWP was introduced. The extra constraint needed to maintain equivalence 
of two opposite chaining implementations, an equal sequence of goal activations, was hard 
to be satisfied in a context of a complex real world problem. A simple syntactical change 
in the translation from backward chaining to forward chaining 1s guaranteed to produce a 
non-functioning strategic level since it will cause a different sequence of goal activations. 
Fortunately, two sets of equivalences are found in the context of the strategic level of RBM. 


One is the equivalence of Prolog rules and AND/OR goal trees, and the other is the 


equivalence of CLIPS forward chaining rules and STDWP.® 

The graphical equivalence between an AND/OR goal tree and a STDWP has 
been shown in [Ref. 9]; the logical and behavioral equivalence of corresponding 
implementations in Prolog vs. CLIPS was empirically proven in the previous chapter. 

To support these findings, both graphical tools and either implementation 1s being 


applied to the strategic level of RBM for the NPS AUV in the following section. 


2. The Implementation of the Strategic Level 
The RBM’s strategic level was initially implemented in Prolog because of 
Prolog’s hierarchical order and its determination of sequence of primitive goals. The source 
code of this implementation is presented in APPENDIX C. The corresponding AND/OR 
goal tree may be found in APPENDIX D and the STDWP in APPENDIX E. The 


complexity of either graphical representation is considered to be not too big so that it 


8. The equivalence relationship is empirically known to be correct. Formal proof is not available 
yel. 
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becomes impractical. Both graphs support enough readability and may be used side by side 
since they provide equivalent logic and behavior. 

The implementation in CLIPS was derived from Prolog’s source code and was 
first carried out “manually”. Although the fundamental and theoretical background was 
still not exactly defined by the time of translation, a translation pattern was already found 
and used. 

The CLIPS code as it is presented in APPENDIX C is an enhanced version of the 
initial program. It differs slightly from the structures introduced and discussed in the 
previous sections since the translation was completed based on preliminary findings. 
Nevertheless, a syntactically clean version that accomplishes a “clean” translation 
according to the implementation structures introduced in the previous chapter 1s already in 
progress and will be reported !ater. 

However, the equivalent sequence of the behavioral activation is empirically 
confirmed for both, the Prolog and the CLIPS implementations [Ref. 9]. That means, that 
either version of the strategic level, whether Prolog or CLIPS, produces exactly the same 
sequence of behaviors during mission control and execution when it controls the NPS 
AUV’s simulator [Ref. 9]. This observation was also made when the CLIPS code was used 


in CLIPS/Ada for the tactical level’s software testing in [Ref. 14]. 
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V. SUMMARY AND CONCLUSIONS 


STDWP’s add a new dimension to conventional STD’s by permitting non-disjoint 
state transition conditions to multiple successor states. The non-determinism introduced by 
this extension 1s resolved by path priorities. Thus, although several state transitions are 
eligible, only one state transition with highest path priority will be selected to carry out a 
state transition to the next state. With this extension of a conventional STD, a STDWP 1s 
ready to be applied to a new class of problems; 1.e., for graphical representation of forward 
chaining production rules for the strategic level of the RBM. 

Before the STDWP was introduced, the translation of the backward chaining 
implementation of the strategic level in a forward chaining implementation was not 
possible. There were even doubts and confusion about sucha translation among researchers 
at the Naval Postgraduate School because of unique equivalence requirements in the 
strategic level of the RBM; i.e., two implementations have to be not only logically 
equivalent, but also identical in the sequence of proving steps. These requirements led to a 
new class of equivalence of logic. 

If an equivalent forward chaining implementation had not been found, there would 
have been a serious chance that the unique equivalent requirements prevented the Strategic 
level from being qualified as a subset of a rule-based system. However, an equivalent 
forward chaining implementation of the strategic level was successfully hand-coded 
utilizing STDWP. Most likely, there always exists two equivalent chaining 


implementations in each direction because of the found algorithm which allows bi- 


directional translation! [Ref. 7]. However, a formal proof for existence of two opposite 
chaining implementation is not researched yet. A formal proof will automatically provide 
another evidence for that a strategic level of RBM is a true subset of a conventional rule- 
based reasoning system which only concerns about logical equivalence. But this is also 


another future research topic. 


1. The correctness and completeness of this algorithm is not proved yet. 
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Another discovery from the presented work is complexity, compared between two 
implementations. Backward chaining implementation is always simpler than _ the 
corresponding forward chaining implementation. For example, comparing the number of 
nodes in the AND/OR goal tree in Figure]0 with the number of states in the STDWP in 
Figure 12 results in a difference of 7, that is 2] nodes vs. 28 states. A similar discovery is 
reported in a different context [Ref. 17]. 

The previous discovery can be summarized as follows: an AND/OR goal tree is 
viewed as a goal decomposition diagram, and a STDWP is considered as a goal execution 


diagram with explicit goal execution details. The former can be seen as a disassembly 


diagram, the latter can be interpreted as an assembly diagram.” In a computational aspect, 
the former demands more than the latter implementation. Actually, faster execution was 
observed in the CLIPS implementation even though the size of the code is about ten times 
bigger than the equivalent Prolog code. This observation supports the role of the AND/OR 
goal tree’s depth first traverser. The depth first traverser interprets the AND/OR goal tree, 
and it produces a sequence of goal activations depending on a situation on fly whereas the 
STDWP needs little computation because it can be seen as a collection of all possible 
execution paths. Whether or not the translation problem is the same class of problems as 
that presented by [Ref. 17] 1s another future research topic. 

The final issue is whether an equivalent STDWP is a minimum representation or not. 
If this is not the case, then it has to be researched how to make a minimum STDWYP. This 
issue seems not to be discussed in Homem de Mello’s research. [Ref. 17] 

Once the above mentioned research questions are fully answered, then those findings 
will immediately lead to an economy of mission description in general (mission descmption 
for either AUV or human military unit); i.e., an AND/OR goal tree style mission 
description vs. a STDWP style mission description. The observation of current practices 


among people in general reveals two side stories. If a mission is well defined and well 


2. Loosely speaking, disassembling a device is an easier task than assembling it. 
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understood, then an AND/OR goal tree style mission description is common. On the other 
hand, the opposite is true. A military AUV mission and a scientific discovering AUV 
mission show two examples, one for each side. 

The research presented in this study 1s just opening up whole new issues rather than 
reducing them by solving existing problems. This recognition might be an herald of an 


extremely interesting research area. 
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APPENDIX A. CLIPS IMPLEMENTATION OF THE EXAMPLE IN 


SECTION IV.C. 


a KK KKK KKK KKK KKK KK KKK KKK KKK KK KEKEKKKKKK KK KKK KKK KK KKK KKK KKK KKK KKK KKK KKK KKK KK 
‘ 


eae Tit be Example for Thesis, Section IV.C. 
oe Name example2.2 

ae Version oes 

oo Author Thomas Scholz 

eal Date : 18 May 1993 

ne Revised 15 September 1993 

a System UNIX Sun/Solbourne 

ie Compiler Clips 2a.) 


REE KKK KK KKK KKK KK KKK KKK KEK KKK KEK KEK KKK KKK KK KK KK KKK K KKK KKK KKK KKK KKK KKK 
f 


(deftemplate rule-A 
(field state 
(type SYMBOL) 
(allowed-symbols 


(deftemplate rule-B 
(field state 
(type SYMBOL) 
(allowed-symbols 


(deftemplate B-branches 
(field branch 
(type SYMBOL) 
(allowed-symbols 


(deftemplate rule-C 
(field state 
(type SYMBOL) 
(allowed-symbols 


(deftemplate C-branches 
(field branch 
(type SYMBOL) 
(allowed-symbols 


(deftemplate rule-D 
(field state 
(type SYMBOL) 
(allowed-symbols 


(deftemplate D-branches 
(tield branch 
(type SYMBOL) 
(allowed-symbols 
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Start B © ~D: -done) })) 


start D E F _ done))) 


Bet) 2B -Z).)) 


start D E F done))) 


ee 2g ee) 


start G H_ done))) 


Doh D-2))) 


mcm eee em ee eee eee ee we eee ii 


(defrule start-program 
2x == (initial—-fact) 


(recract (>) 

(assert (rule-A (state B))) 

(printout t crlfi “PATH through STDWP:" crlf crlfi "“A-stalee 
ert} ) 


(defrule rule-A-state-B 
?x <- (rule-A (state B)) 


(retract <2x) 
(assert (rule-B (state start)))) 


(defrule rule-A-state-C 
(declare (salience -10)) 
?x <- (rule-B (state done) ) 


(retract~ 7) 
(assert (rule-C (state start)))) 


(defrule rule-A-state-D 
(declare (salience -20)) 
?x <- (rule-C (state done) ) 


(retract 2x) 
(assert (rule-D (state start)))) 


(defrule rule-A-state-done 
(declare (salience -30)) 
?x <- (rule-D (state done) ) 


(retract. x) 

(assert (rule-A (state done) )) 

(printout t “A-done" crilf crlf “** Successful termination 
Cyl ti wer it) 


(defrule total-failure 
(declare (salience -100)) 


(mot (rule-A (state done) )) 


(printout t crlf “* Premature Termination, no success ig 
Crlreerls: yy) 
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2 om ee ee ww eee eee ee eee see 


(defrule B-branch-l-start 
?x <- (rule-B (state start) ) 


(retract. 2x) 
(assert (B-branches (branch B-1)))) 


(deftrule B-branch-2-start 
(declare (salience -1)) 
2x <- (B-branches (branch B-1)) 
?y <- (rule-B (state ?)) 


(retract ?x) 
(yretrac” ?y) 
(assert (B-branches (branch B-2)))) 


(defrule B-branches-clean-up 
(declare (salience -2)) 
?x <- (B-branches (branch B-2)) 
yee rule -Bwiiskate.. 7) 


== 
(vetract..\7 x) 
(retract ?y) 
(Brinbeove, to "** Nor Bebranch successrul: = crit) 
a a a a a ene B-l-branei-——— 


(defrule B-branch-l-state-D 
(B-branches (branch B-1) ) 


(assert (rule-B (state D))) 
(assert (rule-D (state start) )) 
(printout t "“B-start (branch B=-1); ")) 


(defrule B-branch-1l-state-E 
(B-branches (branch B-1)) 
?x <- (rule-B (state D)) 
?y <- (rule-D (state done) ) 


(retract 7x) 


(retract ?y) 
(assert (rule-B (state E)))) 


—_—— eee ee i i ee eee eee ee ie ie ie ii a le 
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; If “(fact BE)" exists, *(rule-B (state done))" will follow immediate 


‘ 


(defrule B-branch-l-state-done 
?x <- (B-branches (branch B-1)) 
?y <- (rule-B (state E)) 


(fact §) 
=> 
(retract ?x) 
(retract ?y) 
(assert (rule-B (state done))) 
(printout t “E-state; B-done; “ crlf)) 
ee  - - - e B-2-bDranen.—a 


(defrule B-branch-2-state-F 
(B-branches (branch B-2)) 


= 
(assert (rule-B (state F))) 
(DrInEOUG, co branch Bel: failure ©" ert 
*B-start. (branch B-2)>; ")) 
; If "(fact F)" exists, "(rule-B (state done))" will follow immediately. 


emer wa iw iii 


(defrule B-branch-2-state-done 
?x <- (B-branches (branch B-2)) 
2y “<= “(rule-=B (state FF) } 
(fact F) 


(retraces. %) 
(retract -2y) 


(assert (rule-B (state done) ) ) 
(orintout ts “F-state +, B-done> ” “ecrir)) 


mmm mw wwii ie i ee 


Se a re ee ee ee eee ee eee Traffic rulesss 
(defrule C-branch-l-start 
?x <- (rule-C (state start) ) 


(retract ?x) 
(assert (C-branches (branch C-1)))) 


(defrule C-branch-2-start 


aa 


(declare (salience -1)) 
?x <- (C-branches (branch C-1)) 
eye (elle -Ge states 7).) 


(retract ?x) 
(retract >y) 
(assert (C-branches (branch C-2)))) 


(defrule C-branch-3-start 
(declare (salience -2)) 
?x <- (C-branches (branch C-2)) 
ey <= (rule-C. (state 2) 


(retract ?x) 
(retract ?y) 
(assert (C-branches (branch C-3)))) 


(defrule C-branches-clean-up 
(declare (salience -2)) 
?x <- (C-branches (branch C-3)) 
ay -<—' (rule-C {state 7))} 


(retract ?x) 
(retract ?y) 
(orimtoue: €o"™ INOvG=pbranch successful =" “eri )) 


© meee eee i ee eee eee ema se ee Ss Ee ee er srr er er 


la C-l branch------ 
(defrule C-branch-1-state-D 

(C-branches (branch C-1)) 
=> 

(assert (rule-C (state D))) 

(assert (rule-D (state start) )) 

(PrantGutateeCostart (branch C=) 7.4) ) 


(defrule C-branch-l-state-* 
(C-branches (branch C-1)) 
?x <- (rule-C (state D)) 
?y <- (rule-D (state done) ) 


(retract. ?x) 
(retract ?y) 
(assert (rule-C (state E)))) 


meee we ee es ee eee ee eee ee eee ee eee eee eee i 


; If "(fact E)" exists, “(rule-C (state F))" will follow immediately. 


om ee oe wi ew ww ws ws ae ei ie ie ie ss si 


(defrule C-branch-l-state-F 
(C-branches (branch C-1)) 
2x <- (rule-C (state E)) 
(fact E) 
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(retract ?x) 
(assert (rule-C (state F))) 
(Orintout)t *E=states:'") ) 


; If “(fact F)"“ exists, “(rule-C (state done))" will follow immediately. 


nem mmm www wwe ww ww www ww wwe ei ia ie ie ee ee ee ee ee 


(defrule C-branch-1l-state-done 
?x <- (C-branches (branch C-1)) 
2y <=-— {rule-C (stateuF )) 
(tact oF) 


(retract 7x) 

(reRract. ey) 

(assert (rule-C (state done) )) 
(Princoutt "“F-=state; C=done; "-erit£)} 


Vee S SSS SSS = Sosa Sea ete ts eee cee tr SS eee Se C=2 Ppranch--—=——— 
(defrule C-branch-2-state-D 
(C-branches (branch C-2) ) 


(assert (rule-C (state D))) 

(assert (rule-D (state start))) 

[era neceuieMiib=' *tbrancheea feailire Cet 
"C=etarc’ (branch. 1G=2) 3. }) 


(defrule C-branch-2-state-F 
(C-branches (branch C-2)) 
7x <- (rule-C (state D)) 
?y == ({rudle-D (state-done) ) 


II 
V 


(retract. -x) 
(Betrace 2) 
(assert (rule-C (state F)))) 


mmm www ww ww www we ww www www ww www www www ww ww ii 


; If "(fact F)”" exists, “(rule-C (state done))” will follow immediately. 


mmc meee ee ie ww ee ee ee 


f 


(defrule C-branch-2-state-done 
2x <= (C-branches (branch C-2) ) 
7V-=—-o (rulle-—© (state F))) 
Ciheacte oF) 


retract. 7x) 

retract) 7y) 

assert (rule-C (state done))) 
brintout t “F=-state> C=done?.“™“«crlt)) 


Fee oe Ee 
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ee ee ee ee ee = SS =) Joranei~-—= 


‘ 


(defrule C-branch-3-state-E 
(C-branches {branch C-3) ) 


— 
(assert (rule-C (state E))) 
(OFInmtouc’ t. ~7« branch C-2 failure: 74" veri? 
"C-sStart. “(branen ©-3)> “)) 

; If “(fact E)" exists, “(rule-C (state done))" will follow immediately. 


mee we ie we ie ie ie ee SS Ss ee 


‘ 


(defrule C-branch-3-state-done 
2x <- (C-branches (branch C-3)) 
oy <= (rulle-C (state E)) 


(fact E) 
= 
(retract ?x) 
(retract ?y) 
(assert (rule-C (state done) )) 
(pF iImvout ti. *E-=states«Cc-done- “icrlt)>) 
Pines +S SS ee ee PE 1G eit re omer 
2b <= G. 
moo wt. 


me www ww we i ww ww i ww ww ww ww ww ww ww we www ww ww www ww i i = Ce 


‘ 


(defrule D-branch-l-start 
2x <- (rule-D (state start) ) 


(retracc. 7x) 
(assert (D-branches (branch D-1)))) 


(defrule D-branch-2-start 
(declare (salience -1l)) 
?x <- (D-branches (branch D-1) ) 
2ye<-  (rule-D (state 7)) 


(retract 2x) 
(petract 1) 
(assert (D-branches (branch D-2)))) 


(defrule D-branches-clean-up 
(declare (salience -1l)) 
2x <- (D-branches (branch D-2)) 


ey -<="(rule-D (state 7?) ) 


(retract ?x) 
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Lret racer 2y) 
(printouts tt. ** No D-branch successtil ““2erit)) 


mmm ww www ww ew ws ww ww wei i eee ee eee eee ei ei i 


poco ccc po eo eo ee eee D-1-branch---- 
(defrule D-branch-l-state-G 
(D-branches (branch D-1)) 


(assert (rule-D (state G))) 
(printout G "“D=stert. (branen p=)" )) 


; If “(fact G)" exists, “(rule-D (state done))" will follow immediately. 
(defrule D-branch-1l-state-done 

?x <- (D-branches (branch D-1)) 

?y <- (rule-D (state G)) 

(fact G) 


retract 7x) 

retract ?y) 

assert (rule-D (state done) )) 
printout t-"G-state:  D=-done:;” cri £) ) 


ee gl gl 


meme ewe eee ee eee ww ww www ww wee ie se 


(defrule D-branch-2-state-H 
(D-branches (branch D-2)) 


=> 
(assert (rule-D (state H))) 
(Brineout tty branch Dsl ufailurens] ernlt 
"Destart (branch .D-2)5<")) 
- If "(fact H)" exists, "“(rule-D (state done))“ will follow immediatel, 


mmm meee wee ew ee ee ee eee ee ees sa ss se 


‘ 


(defrule D-branch-2-state-done 
?x <- (D-branches (branch D-2)) 
?y <- (rule-D (state H)) 
(fact —H) 


(eeCract ~7x) 

(yet ract <7) 

(assert (rule-D (state done))) 
(oY Intout’t>“H-state: D-done.* ‘crt )) 


meee eee eee 


ae KKK KE KKK K KKK KK KKK KK KKK KK KEK KKK KKK KKK KKK HKEKKKEKKKKKK KKK KKK KKK KK KKK KK KK KK 
’ 
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APPENDIX B. CLIPS IMPLEMENTATION OF THE EXAMPLE IN 
SECTION IV.D. 


KKK KEK KKK KKK KKK KKK KKK KK KKK KKK KK KKK Kh Kh Kh KKK KKK KKK Kh KK KK KKK KKK KKK KKK KKK KKK Kk 
f 


2e Title : Example for Thesis, section IV.D. 
a7 Name : newl.5 

oe Version tle 

og Author > Thomas Scnolz 

Date : 9 September 1993 

she Revised : 15 September 1993 

ie System : Sun/Solbourne UNIX 

ne Compiler Clips 628 

7 Prolog-Code 

a A :- B,Bl. 

a BR ee JC. 

ha Roe] DD. 

as Be ea ae 

rp Ba rere 

as Bee a. 

a Y :- ALPHA, ALPHA]. 

a Vr VBE As Br Al 

; Y :- GAMMA,GAMMAI]. 

ae ts 

am Remarks : No more sequential behavior. After a branch failure, all 
- remaining choices compete again. 
. Implementation of “OR-AND-OR-OR - Relationship”. 


kKaekekewekeke Keke keh Keke Kh KKK Kh Kh Kh KK Kh Ke Ke Kh Ke KKK KK KK KKK KK KKK KKK KKK KKK KK KKK KK KK KK KK Kk KKK Kk Ke kK 


(deftemplate A 
(field state 
(type SYMBOL) 
(allowed-symbols Start. B Bly“. “Glir*D- -Pl 2-done)) 
(field status 
(type SYMBOL) 
(allowed-symbols reveal “hide succeeded failed) 
(default reveal))) 


(deftemplate B 
(field state 
(type SYMBOL) 
(allowed-symbols Staitork Sl oexXZ2 ey, “2.34 sdone)) 
(field status 
(type SYMBOL) 
(allowed-symbols reveal hide succeeded failed) 
(default reveal))) 
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(deftemplate Y 

(field state 
(type SYMBOL) 
(allowed-symbols start ALPHA ALPHA] BETA BETAI 

GAMMA GAMMA] done) ) 

(field status 
(type SYMBOL) 
(allowed-symbols reveal hide succeeded failed) 
(default reveal))) 


(defrule start-program 
2x <= (initial—fact) 
(condition A) 


(retract ?x) 
(assert (A (state start) )) 
(printout t€ crlfi *“PATH through STDWP* crit criti “A start; -eaeee 


(defrule A-failure 
(declare (salience -10)) 
22 <= Minerva l=fact) 


(retracty: Zz) 
(printout €."*- Total failure “= System halted." crit criae 


(defrule A-start-B 
?x <- (A (state start) ) 
(condition 8) 


(modify ?x (state B) (status hide) ) 
(assert (B (state start) )) 
(printout t “B-state; *)) 


(defrule B-failure 
(declare (salience -10)) 
?x <- (A (state B) (status hide) ) 
?y <-— (BS (stater?7n) (Status: reveal) 
?Z <= (Condition B) 


(retract ?2) 

(modify ?x (state start) (status reveal) ) 

(modify ?y (state ?n) (status failed) ) 

(pelntout €@** branch 4-1) faiture *- A=state” (erie) 


poccccc ccc cc oe oe ee B-l1 branch----= 
(defrule B-start-X 

?x <- (B (state start) (status reveal) ) 

(A (state B) (status hide) ) 

(eondle ion x) 
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(modify ?x (state X) (status hide) ) 
; (modify ?y (status hide) ) 
(prinvout £“s-state, “)4 


(defrule X-failure 
(declare (salience -10)) 
2x <- (B (state ?n) (status hide) ) 
Cyan (eonditioen 2) 


(retract ?y) 
(modify ?x (state start) (status reveal) ) 
(Printout “© “**«branchn ‘B-l failure *; B-state” 


(defrule B-start-Xl 
?x <- (B (state X)) 
(COndit ion +s) 


(modify ?x (state X1)) 
(printout tx @xl=state- *)) 


(defrule B-start-xX2 
?x <- (B (state X1)) 
(conait ron. x2) 


(modify ?x (state X2)) 
(Brantout it. "“xX2-state: “)) 


(defrule B-donel 
7x <- (B (state X2)) 
2?y <- (A (state B)) 


(modify ?x (state done) (status reveal) ) 
(modify ?y (status reveal) ) 
(prIMmeout t eri: “B-done; <")} 


pone --- + B-2 branch 


(defrule B-start-yY 
(declare (salience -1)) 
?X <- (B (state start) (status reveal) ) 
(Condition. Y) 


(modify ?x (state Y) (status hide) ) 
(assert (Y (state start) )) 
(DiintCultmuers ~-state>.)” “cri ft) ) 


(defrule Y-failure 
(declare (salience -10)) 
2x <- (B (state Y) (status hide) ) 
?y <- (Y (state start) (status reveal) ) 
eZ <> (condition Y) 


Dil 


er LE.) ) 


(retract (7z) 

(modify ?x (state start) (status reveal) ) 

(modify ?y (status failed) ) 

(printout t “* branch B-2 failure *; B-state; *% crlf)) 


(defrule Y-start-ALPHA 
2x <- (Y (state start) (status reveal) ) 
(eondition ALPHA) 


(modify ?x (state ALPHA) ) 
(printout tC: *“ALPHA=state~ *)) 


(defrule ALPHA-failure 
(declare (salience -10)) 

: ?y <- (B (state Y) (status hide) ) 
?x <- (Y (state ?n) (status reveal) ) 
2?z <- (condition ALPHA) 


(retract ?2) 

(modify ?x (state start) (status reveal) ) 

(modify ?y (status failed) ) 

(DEIncout st -*spranchra—) (tailuteq= = Y-state: : Ser lf) 
(defrule Y-start-ALPHAI] 

?x <- (Y (state ALPHA) ) 

(condition ALPHA1) 


(modify ?x (state ALPHA1) ) 
(printout t “ALPHAl-state; ”)) 


(defrule Y-done-l 
?x <- (Y (state ALPHAL1) ) 
?y <- (B (state Y)) 
?z <- (A (status hide) ) 


(modify ?x (state done) (status succeeded) ) 
(modify ?y (state done) (status reveal) ) 
: (modify ?z (status reveal) ) 

(printout. © crit “Y-dene-.B-dene “).) 
Gr rrr rcs end of Y-1l branch--- 
pot en re ere Y-2 branch-—=— 440 
(defrule Y-start-BETA 

(declare (salience -1)) 

2x <- (Y (state start) (status reveal) ) 

(Condadvt ion -BETA) 


(modify ?x (state BETA) ) 
(printout © “BETA-state: 9") ) 


DZ 


(defrule BETA-failure 
(declare (salience -10)) 

: ?x <- (B (state Y) (status hide) ) 
?x <- (Y (state ?n) (status reveal) ) 
?20<— “condition, BETA} 


(retract ?2z) 
(modify ?x (state start) (status reveal) ) 
: (modify ?y (status failed) ) 
(PLrIntout wt. ** “oraneh Y-2 tart lure “sy y-state: * crif)) 


(defrule Y-start-BETA1 
?x <- (Y (state BETA) ) 
(condition BETA1) 


(modify ?x (state BETA1) ) 
(prantout ©. “BETAl-state,;*”)) 


(defrule Y-done-2 
?x <- (Y (state BETA1) ) 
ey eS he State Y) } 
2 <—- (A (status hide) } 


(modify ?x (state done) (status succeeded) ) 
(modify ?y (state done) (status reveal) ) 

: (modify ?z2 (status reveal) ) 
(printout tC crit “Yedone- “B=dene;.”)) 


(defrule Y-start-GAMMA 
(declare (salience -2)) 
ex == (Y (state start) } 
(condition GAMMA) 


(modify ?x (state GAMMA) ) 
(printout t “GAMMA-state; ”)) 


(defrule GAMMA-failure 

(declare (salience -10)) 

27x <- (Y (state ?n) (status reveal) ) 
: ?y <- (B (state Y) (status hide) ) 

?Z <- (condition GAMMA) 


(retract 72) 
; (modify ?x (status failed) ) 
(modify ?x (state start) (status reveal) ) 
ferineouret “*Sibranch Y-3 tatlure *— Y-staete.. * crit) } 


(defrule Y-start-GAMMA1 


2x <- (Y (state GAMMA) ) 
(condition GAMMA1) 
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(modify ?x (state GAMMA1) ) 
(printout t “GAMMA]-state; “”)) 


(defrule Y-done-3 
?x <- (Y (state GAMMA) ) 
?y <- (B (state Y)) 
; ?z <- (A (state B) (status hide) ) 


(modify ?x (state done) (status succeeded) ) 

(modify ?y (state done) (status reveal) ) 
; (modify ?z (status reveal) ) 

(Printout t criti “VY-domne-se-done; =)) 
poco tcc cc crc rr en end of Y-3 branch--- 
po rr rr re re er re ere rr eree B-3 branch--------- 
(defrule B-start-Z 

(declare (salience -2)) 

?x <- (B (state start) (status reveal) ) 

(A (state B) (status hide) ) 

(eondreven's) 


(modify ?x (state Z) (status hide) ) 
; (modify ?y (status hide) ) 
(printout Zestate- )) 


(defrule Z-failure 
(declare (salience -10)) 
?x <- (B (state ?n) (status hide) ) 
oy <=] (condi trcneZ) 


{(reerace =v) 
(modify ?x (state start) (status reveal) ) 
(prantout t “= branes B-3 tal lure > S-ctate”-crir)) 


(defrule B-start-Zl 
2x <a) CBr (estate sZ):) 
(Gonait teneec1) 


(modify ?x (state Z1)) 
(Printout 6. “Zi-state. 4 )o 


(defrule B-done-2 
ee =: (VB tstaberZ1) 
ay <— Fas eace By) 


(modify ?x (state done) (status reveal) ) 
(modify ?y (status reveal) ) 
(printout t crlf,*B=<done= A-done:” -erlf -erlet 
7? -Successtuls termination =" erie erile).) 
port t ttt tr rr end of B-3 branch----- 
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(defrule A-start-Bl 
2x <- (A (state B)) 
(B (state done) (status reveal) ) 
(eGondition Bl) 


(modify ?x (state Bl)) 
(printout £ *Bl=state;.“%)) 


(defrule A-done-1l 
?x <- (A (state Bl)) 


(modify ?x (state done) (status succeeded) ) 
(printout © crit, “A-done-* -crif-crif ~* Successful ‘termination *” 
Cte ter 1 £ )/) 


(defrule A-start-C 
(declare: (salience -1)) 
?x <- (A (state start) ) 
(COnagition<c) 


(modify ?x (state C)) 
(DEInrout © “G-state7.)). 


(defrule C-failure 
(declare (salience -10)) 
?x <- (A (state ?) (status reveal) ) 
2Y -<= -(Condiltaon- ¢) 


(petract-.-y) 

(modify ?x (state start) (status reveal) ) 

(printout tt" *-branch A=-2 failure *~ A-state. * crit) 
(defrule A-start-Cl 

2x <- (A (state C)) 


(cConadteison. Gl) 


(modify ?x (state Cl)) 
(printout. t “~Cl=state; ”)) 


(defrule A-done-2 
?x <- (A (state Cl1)) 


(modify ?x (state done) (status succeeded) ) 
(PE Ineoulietacr nh aA —done;"*criteculfr “* Suceesstul® termination *” 


meno oe = SS = end of A-2 branch------ 


> 


> --------_-_.-- __ __- --- ---- + => ++ A-3 branch---------=—2a. 
(defrule A-start-D 

(declare (salience -2)) 

?x <- (A (state start) ) 

(Conditions dD) 


(modify ?x (state D)) 
(prineOus t “Destate;, )5 


(defrule D-failure 
(declare (salience -10)) 
?x <- (A (state ?) (status reveal) ) 
2 == (Condition Dp) 


(VEE ract.2y ) 

(modify -x\ (Status failed) ) 

(Dri nGout ce: oT branehiA=s-fallire “eA astate. Cr lt ricim ibe 
(printout t ** No A-branch successful *. System halted.” crlf crite 


(defrule A-start-Dl 
?x <- (A (state D)) 


(eGndie1oneD.) 


(modiivy 7x“ state bl] )) 
(printout t “Dil-state;*)) 


(defrule A-done-3 
2x <- (A (state D1) ) 


(modify ?x (state done) (status succeeded) ) 
(printout t crlf “A-done;:* crlf erli “* Successful terminat tones 


é 
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APPENDIX C. PROLOG IMPLEMENTATION OF THE RBM’S 
STRATEGIC LEVEL 


lex Strategic Level for the RBM AUV Mission Controller/Coordinator 
by Byrnes, Kwak, Healey, Marco for use at Florida competition 


Version: 2.2 “Oct 627, 1992 ro 
[*® xno ce cee ee rrr ree MISSION: SPECIFICATION .—----—---------— my. 
initialize :- ready_veh_for_launch(ANS1), 
ANS] == 1, select_first_waypoint (ANS2) . 
initialize :- alert_user(ANS), fail. 
massion =—- Inl2transit2p(ANS1), ANS] == 1]17,transit, ?!, 
transit_done_p(ANS2), 
RNS 2 ee alee, Earl: 
mission :- in_search_p(ANS1), ANS1 == 1, search, !, 
search_done_p(ANS2), ANS2 == 1, fail. 
MisSion := in task -p(ANS1), ANS] == 1, task, !, task done_p(ANS2), 
ANS2Z2==. lee elas.* 
mission. <-> in return p(ANS!]), ANS] == 1, return, !, return_done_p(ANS2), 
ANS2 == 1, wait for _ recovery (ANS3) . 
transit :- waypoint_control. 
transit :- surface(ANS). 
search :- do_search_pattern(ANS), ANS == 1. 
search :- surface(ANS). 
ask =) homing (ANSI), ANS] == 1, “drop_package(ANS2), ANSz2 == 1, 
get_gps_fix(ANS3), ANS3 == 1, get_next_waypoint (ANS4), ANS4 == 1. 
task :- surface(ANS). 
return :- waypoint_control. 
return :- surface(ANS). 
[© weer errr rr rr rr rrr re eee NPS AUV DOCTRINE -------------- oh 
execute_auv_mission :- initialize, repeat, mission. 
waypoint_control :- not(crit_system_prob), get_waypoint_status, 


plan, send_setpoints_and_modes(ANS). 


/* need to monitor accuracy of transit relative to current and GPS */ 
/*obstacle avoidance in Tac, replanning in Strategic */ 


get_waypoint_status :- gps_check, reach_waypoint(ANS1), ANS] <== 1, 


ay 


get_next_waypoint (ANS2). 
get_waypoint_status. 


gps_check :- gps_needed(ANS1), ANS] == 1, get_gps_fix(ANS]1). 
gps_check. 
/* Planning: reduced capability (cut mission short), system degradation 


(continue mission at lower performance), obstacle avoidance, normal. 
g system*/ 


plan :- red_cap_system_prob, global_replan. 


/* Subset of system probs requiring replan (TBD) */ 


plan :- near_uncharted_obstacle, local _replan. 
plan. 
near_uncharted_obstacle :=- unk_obstacle_p(ANS1), ANS] == 1, 


log_new_obstacle(ANS2). 
local_replan :- loiter(ANS1), start_local_replanner(ANS2). 
global_replan :- loiter(ANS1), start_global_replanner (ANS2). 
Crit_system prob +- power gone p(ANS), ANS == 1. 
crit_system_prob :- computer_system_inop_p(ANS), ANS 


crit_system_prob :- propulsion_system_p(ANS), ANS == 
crit_system_prob :- steering_system_inop_p(ANS), ANS 


te tl 
Hoe Wl 
i i) 


red_cap_system_prob :- diving_system_p(ANS), ANS == 1. 
red_cap_system_prob :- bouyancy_system_p(ANS), ANS = 
red_cap_system_prob :- thruster_system_p(ANS), ANS = 
red_cap_system_prob :- leak_test_p(ANS), ANS == 1. 
red_cap_system_prob :- payload_prob_p(ANS), ANS == 


de 
Te 


- 
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APPENDIX F. CLIPS IMPLEMENTATION OF THE STRATEGIC 
LEVEL 


0 2 oo ok ok oR a ie ie ke 2 2k oe ok ok ok oe oo ok oe ke ok ok 2k 2 2k ok ok ake ok ok a ke oie akc aie ake oie ake ok ake ak ak i ke ok ok ak a oe oc ake ok 2k ok ok ok kok a ok ie ok ok ake ake ok ok ok 2k ok ok 
9 


ok 

* Tatie : Strategic Level for the NPS AUV II 

;* Name : strlev6.20 

; “Version 26.20 

** Author =: Thomas Scholz 

+ Date : 10 August 1993 

** Revised 

>* System :Sun3 UNIX; server's name “virgo” 

** Compiler : CLIPS/Ada 4.40 

** Description : This program is the strategic level of the NPS AUV II, 
ay top level of the Rational Behavioral Model design 

ox . 

** Remarks — : The function names (i.e. “diving_system_prob_p”) match the 
_ names that have been used in the tactical level code of 
a Fritz Thornton [Ref. 13] 


% 


ok kk kk kk kk kk ik a ak ak ak a aka aka aka ak ak ak kak ak ak ok ak ak ak ai ak ak ai ak ake ak a 2k ak ake ak ok ake ak a ai a ake ake ake ae ie oie ak ok ic ok 2 a 2k 2k ok 2k 
9 


eRe eee eee NPS AUY = REM Mission-ContolerGoordmnaton =~ * tage eee 


. AR a 2k ok oa ok ok ok ok a ok ak ok ok 2k ok 
ARRAS Ee ete ee eee ee ern re eI lates ee ome a + 


(deftemplate execute-auv-mission 
(field state 
(type SYMBOL) 
(allowed-symbols Start initialize mission done))) 


(deftemplate initialize 
(field state 

(type SYMBOL) 

(allowed-symbols stan 
ready-vehicle-for-launch 
select-first-waypoint 
alert-user 
done))) 


(deftemplate initialize-branches 
(field branch 
(type INTEGER) (range 1 2)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 
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(deftemplate mission 
(field state 

(type SYMBOL) 

(allowed-symbols Start 
transit in-transit-p transit-done-p 
search in-Search-p search-done-p 
task in-task-p _ task-done-p 
retum in-return-p return-done-p 
wait-for-recovery 
done))) 


(deftemplate mission-branches 
(field branch 
(type INTEGER) (range 1] 4)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate transit 
(field state 
(type SYMBOL) 
(allowed-symbols Start 
waypoint-conuol 
surface 
done))) 


(deftemplate transit-branches 
(field branch 
(type INTEGER) (range | 2)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate search 
(field state 
(type SYMBOL) 
(allowed-symbols Start 
do-search-pattern 
surface 
done))) 


(deftemplate search-branches 
(field branch 
(type INTEGER) (range | 2)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate task 
(field state 
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(type SYMBOL) 

(allowed-symbols Start 
homing drop-package 
get-gps-fix 
get-next-waypoint 
surface 
done))) 


(deftemplate task-branches 
(field branch 
(type INTEGER) (range 1 2)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate return 
(field state 
(type SYMBOL) 
(allowed-symbols stan 
waypoint-control 
surface 
done))) 


(deftemplate return-branches 
(field branch 
(type INTEGER) (range 1 2)) 
(field status 
(type SYMBOL) 
(allowed-symhbols try failed))) 


(deftemplate waypoint-conto! 
(field state 

(type SYMBOL) 

(allowed-symbols Start 
crit-system-prob 
get-waypoint-status 
plan 
send-setpoints-and-modes 
done))) 


(deftemplate get-waypoint-status 
(field state 


(type SYMBOL) 
(allowed-symbols Start 
gps-check 


reach-waypoint 
get-next-waypoint 
done))) 


(deftemplate get-waypoint-status-branches 
(field branch 


(type INTEGER) (range 1 2)) 
(field status 

(type SYMBOL) 

(allowed-symbols try failed))) 


(deftemplate gps-check 
(field state 
(type SYMBOL) 
(allowed-symbols Start 
gps-needed 
get-gps-fix 
done))) 


(deftemplate gps-check-branches 
(field branch 
(type INTEGER) (range 1 2)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate plan 
(field state 

(type SYMBOL) 

(allowed-symbols Start 
red-cap-system-prob 
global-replan 
near-uncharted-obstacle 
local-replan 
done))) 


(deftemplate plan-branches 
(field branch 
(type INTEGER) (range I 3)) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate near-uncharted-obstacle 
(field state 
(type SYMBOL) 
(allowed-symbols Start 
unknown-obstacle-p 
log-new-obstacle 
done))) 


(deftemplate local-replan 
(field state 
(type SYMBOL) 
(allowed-symbols Start 
loiter 
Start-local-replanner 
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done))) 


(deftemplate global-replan 
(field state 
(type SYMBOL) 
(allowed-symbols start 
loiter 
start-global-replanner 
done))) 


(deftemplate cnt-system-prob 
(field state 


(type SYMBOL) 
(allowed-symbols Start 
power-gone-p 


compulter-system-inop-p 
propulsion-system-p 
Steering-system-inop-p 
not-done 

done))) 


(deftemplate crit-system-prob-branches 
(field branch 
(type INTEGER) (range | 4))) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


(deftemplate red-cap-system-prob 
(field state 

(type SYMBOL) 

(allowed-symbols Star 
diving-system-p 
bouyancy-system-p 
thruster-system-p 
leak-test-p 
payload-prob-p 
done))) 


(deftemplate red-cap-system-prob-branches 
(field branch 
(type INTEGER) (range 1 5))) 
(field status 
(type SYMBOL) 
(allowed-symbols try failed))) 


© Ae Re ke oe ake a ake ea oe ote of ake ake ake ae ck ak a ak ak i ake ak ak ak af ok ak akc ok ak a ak Rules eo fk ke ek a ke kk ak a ki ak ak tc ake ak ok fc a ate ake ak ak ak ac ok 
9 


(defrule start-program 
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2x <- (start) 
=> 
(retract ?x) 
(assert (execute-auv-mission (state start)))) 


(defrule execute-auv-mission-state-initialize 
2x <- (execute-auv-mission (state Start)) 
=> 
(retract ?x) 
(assert (execute-auv-mission (state initialize))) 
(assert (initialize (state start)))) 


(defrule execute-auv-mission-state-mission 
2x <- (execute-auv-mission (state initialize)) 
?y <- (initialize (state done)) 

=> 
(retract ?x) 
(retract ?y) 
(assert (execute-auv-mission (state mission))) 
(assert (mission (state start)))) 


(defrule execute-auv-mission-state-done 
2x <- (execute-auv-mission (state mission)) 
?y <- (mission (state done)) 


=> 
(retract ?x) 
(retract ?y) 
(assert (execute-auv-mission (state done))) 
(printout t crif © 6 ade aie aie fe af a ake oe ake ake it oe abe ake 2c ake ake ake ake ake ake afc a a abe abe ake ok ie ake 2c ie oe ok ok”? crif 
7 MISSION EXEGUIED SUCECESSRUELY . crit 
-*AUV IS WATTING FOR RECOVERY ..* > cif 
© © ofc ade abe aie ake ake afk ake ake ade aie aie ake ake ake ake ake ade abe ake ade fe ake ake ofc akc ake ake ake abe akc ae oe akc ok °° crif crif)) 
sence renee nee n nnn nnn nnn nnn nnnnn nnn ne initialize traffic rules------------ 


(defrule initialize-branch-1-start 
2x <- (initialize (state start)) 
=> 
(retract ?x) 
(assert (initialize-branches (branch 1)(status try)))) 


(defrule initialize-branch-2-start 

(declare (salience -10)) 

2x <- (initialize-branches (branch 1)(status failed)) 
=> 

(retract ?x) 

(assert (initialize-branches (branch 2)(status try)))) 
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(defrule initialize-branches-clean-up 


=> 


(declare (salience -20)) 
?x <- (initialize-branches (branch 2)(status failed)) 
?y <- (initialize (state ?)) 


(retract ?x) 
(retract ?y) 
(printout t “No initialize branch successful!” crlf crif)) 


(defrule initialize-branch-failure 


(declare (salience -100)) 
?x <- (initialize-branches (branch ?n)(status try)) 
?y <- (initialize (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (initialize-branches (branch ?n)(status fatled)))) 


(defrule initialize- 1 -state-ready-vehicle-for-launch 


=> 


(iniialize-branches (branch 1)(status try)) 


(assert (initialize (state ready-vehicle-for-launch)))) 


(defrule initialize-1-state-select-first-waypoint 


=> 


(initialize-branches (branch 1)(status try)) 
?x <- (initialize (state ready-vehicle-for-launch)) 
(test (= (ready_vehicle_for_launch) 1)) 


(retract ’x) 
(assert (initialize (state select-first-waypoint)))) 


(defrule initialize-1-state-done 


=> 


?x <- (initialize-branches (branch 1)(status try)) 
?y <- (initialize (state select-first-waypoint)) 


(select_first_waypoint) 

(retract ?x) 

(retract ?y) 

(assert (initialize (state done)))) 


(defrule initialize-2-state-alert-user 


=> 


(initialize-branches (branch 2)(status try)) 


(assert (initialize (state alert-user)))) 


(defrule initialize-2-state-done 


?x <- (initialize-branches (branch 2)(status try)) 
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?y <- (initialize (state alert-user)) 


(alert_user) 
(retract ?x) 
(retract ?y) 
(assert (initialize (state done)))) 


(defrule mission-branch-1-start 
2x <- (mission (state start)) 
=> 
(retract ?x) 
(assert (mission-branches (branch 1)(status try)))) 


(defrule mission-branch-2-start 

(declare (salience -10)) 

?x <- (mission-branches (branch 1)(status failed)) 
=> 

(retract ?x) 

(assert (mission-branches (branch 2)(status try)))) 


(defrule mission-branch-3-start 

(declare (salience -20)) 

?x <- (mission-branches (branch 2)(status failed)) 
= 

(retract ?x) 

(assert (mission-branches (branch 3)(status try)))) 


(defrule mission-branch-4-start 

(declare (salience -30)) 

2x <- (mission-branches (branch 3)(status failed)) 
=> 

(retract ?x) 

(assert (mission-branches (branch 4){status try)))) 


(defrule mission-branches-clean-up 
(declare (salience -40)) 
?x <- (mission-branches (branch 4)) 
=> 
(retract ?x) 
(assert (mission (state start)))) 


;(defrule mission-branch-repeat 
; (declare (salience -10000)) 
‘ ?x <- (mission-branches (branch ?n)(status try)) 
;  ?y <- (mission (state ?)) 
=> 
(retract ?x) 
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. 
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° 
9 


(retract ?y) 
(assert (miSsion (state Start)))) 


(defrule mission-branch-failure 


(declare (salience -1000)) 
?x <- (mission-branches (branch ?n)(status try)) 
?y <- (mission (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (mission-branches (branch ?n)(status failed)))) 


(defrule mission- I-state-in-transit-p 


=> 


(mission-branches (branch 1)(status try)) 


(assert (mission (State in-transit-p)))) 


(defrule mission- 1-state-transit 


(mission-branches (branch 1)(status try)) 
?x <- (mission (state in-transit-p)) 
(test (= (in_transit_p) 1)) 


(retract ?x) 
(assert (mission (state transit))) 
(assert (transit (state start)))) 


(defrule mission-]-state-transit-done-p 


?x <- (mission-branches (branch 1)(status try)) 
(mission-branches (branch 1)(status try)) 

?y <- (mission (State transit)) 

?z <- (transit (state done)) 

(test (= (ansit_done_p) 1)) 


(retract ?x) 

(retract ?y) 

(retract ?z) 

(assert (mission (State transit-done-p))) 

(assert (mission-branches (branch 1)(status try))) 


(printout t erlf © 6 ah of ae ak ae ake a ake age ake age ake ake ake ake ake ake oi ade ake fe ade ake ok ak ak ake ak age ake ok ok ok ac ak 7? erlf 


sree TRANSIT SUCCESSEULS 5 crll 


© 6 ae oe ke ee oe oe oe oe ake ae a ke oe a ake oe ake ke oe oi oo oe a ake ake ak ok i ke ok ?? erlf crif)) 


(defrule mission-2-state-in-search-p 


=> 


(mission-branches (branch 2)(status try)) 


(assert (mission (state in-search-p)))) 
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(defrule mission-2-state-search 
(mission-branches (branch 2)(status try)) 
?x <- (mission (State in-search-p)) 
(test (= (in_search_p) 1)) 


(retract ?x) 
(assert (mission (state search))) 
(assert (search (state start)))) 


(defrule mission-2-state-search-done-p 

?x <- (mission-branches (branch 2)(status try)) 
: (mission-branches (branch 2)(status try)) 

?y <- (mission (state search)) 

?z <- (search (state done)) 

(test (= (search_done_p) 1)) 


(retract ?x) 

(retract ?y) 

(retract ?z) 

(assert (mission (state search-done-p))) 

(assert (mission-branches (branch 2)(status try))) 

(printout t erlf © 8 ok ok ok ok ok ok ke ok ke ok kok ok ok oko ok ok ok kok ok ok ok kok ok ok ook ok ok ok ok ok 7 erlf 
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(defrule mission-3-state-in-task-p 
(mission-branches (branch 3)(status try)) 
=> 
(assert (mission (state in-task-p)))) 


(defrule mission-3-state-task 
(mission-branches (branch 3)(status try)) 
?xX <- (mission (state in-task-p)) 
(test (= (in_task_p) 1)) 


(retract ?x) 
(assert (mission (state task))) 
(assert (task (state start)))) 


(defrule mission-3-state-task-done-p 

?x <- (mission-branches (branch 3)(status try)) 
: (mission-branches (branch 3)(status try)) 

?y <- (mission (state task)) 

?Z <- (task (state done)) 

(test (= (task_done_p) 1)) 


(retract ?x) 


(retract ?y) 
(retract ?z) 
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(assert (mission (state task-done-p))) 
(assert (mission-branches (branch 3)(status try))) 
(printout t erlf 6 6h he Re 2 2 oie oi oie oie ake oe ake oie oie ake a aie ake oie ake ok ok ok i oo KK oie ok ke ak ok ok?” erlf 
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(defrule mission-4-state-in-retum-p 
(mission-branches (branch 4)(status try)) 
=> 
(assert (missiOn (state in-return-p)))) 


(defrule mission-4-state-retum 
(mission-branches (branch 4)(status try)) 
?x <- (mission (state in-return-p)) 
(test (= (in_return_p) 1)) 


(TECK Xs. 
(assert (mission (state retum))) 
(assert (return (state start)))) 


(defrule mission-4-state-retum-done-p 
?x <- (mission-branches (branch 4)(status try)) 
(mission-branches (branch 4)(status try)) 
?y <- (mission (State return)) 
?z <- (return (state done)) 
(test (= (return_done_p) !)) 


(retract ?x) 

(retract 7y) 

(retract ?z) 

(wait_for_recovery) 

(printout t crif 8 82h oi ok ok ok oi ok oi ak ok ak ok ok oi ok ok ak oi ok ak ok ak oi aie ok ake ok ok oe ake ok ok ak ak 9? crf 
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(assert (mission (state done)))) 
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(defrule transit-branch-1-start 
2x <- (transit (State start)) 
=> 
(retract ?x) 
(assert (transit-branches (branch 1)(status try)))) 


(defrule transit-branch-2-start 


(declare (salience -10)) 
?x <- (transit-branches (branch 1)(status failed)) 
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=> 
(retract ?x) 
(assert (transit-branches (branch 2)(status try)))) 


(defrule transit-branches-clean-up 
(declare (salience -20)) 
2x <- (transit-branches (branch 2)(status failed)) 
=> 
(retract ?x) 
(printout t “No transit branch successful!” crif crlf)) 


(defrule transit-branch-failure 
(declare (salience -100)) 
?x <- (transit-branches (branch ?n)(status try)) 
?y <- (transit (state ?)) 
=> 
(retract ?x) 
(retract ?y) 
(assert (transit-branches (branch ?n)(status failed)))) 


(defrule transit-] -state-waypoint-control 
(transit-branches (branch 1)(status try)) 
=> 
(assert (transit (state waypoint-control))) 
(assert (waypoint-control (state start)))) 


(defrule transit-] -state-done 
?x <- (transit-branches (branch 1)(status try)) 
?y <- (transit (state waypoint-control)) 
2z <- (waypoint-control (state done)) 


(retract ?x) 
(retract ?y) 
(retract ?z) 
(assert (transit (state done)))) 


(defrule transit-2-state-surface 
(transit-branches (branch 2)(status try)) 
= 
(assert (transit (state surface)))) 


(defrule transit-2-state-done 
?x <- (transit-branches (branch 2)(status try)) 
?y <- (transit (state surface)) 
=> 
(retract ?x) 
(retract ?y) 
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(surface)) 


(assert (transit (state done)))) —; 1S transit done??? 


——_———— SS ms my sc my cr i ee ee se ee es ee ee 
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(defrule search-branch-1-start 
?x <- (search (state start)) 
=> 
(retract ?x) 
(assert (Search-branches (branch 1)(status try)))) 


(defrule search-branch-2-stan 
(declare (salience -10)) 
?x <- (search-branches (branch 1! )(status failed)) 


(retract ?x) 
(assert (search-branches (branch 2)(status try)))) 


(defrule search-branches-clean-up 
(declare (salience -20)) 
°?x <- (search-branches (branch 2)(status failed)) 


(retract 27x) 
(printout t “No search branch successful!” crlf crlf)) 


(defrule search-branch-failure 
(declare (salience -!00)) 
2x <- (search-branches (branch ?n)(status try)) 
?y <- (search (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (search-branches (branch ?n)(status failed)))) 


(defrule search- ]-state-do-search-pattern 
(search-branches (branch 1)(status try)) 
=> 
(assert (search (state do-search-pattern)))) 


(defrule search-1-state-done 
?x <- (search-branches (branch 1)(status try)) 
?y <- (search (state do-search-pattern)) 
(test (= (do_search_pattem) 1)) 


(retract ?x) 


(retract ?y) 
(assert (search (state done)))) 
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(defrule search-2-state-surface 
(search-branches (branch 2)(status try)) 
=> 
(assert (Search (state surface)))) 


(defrule search-2-state-done 
?x <- (Search-branches (branch 2)(status try)) 
2y <- (search (state surface)) 
> 
(retract ?x) 
(retract ?y) 
(surface)) 


(assert (transit (state done)))) —; 1s transit done??? 


mm mc em re ee a eee i ee a sea esas ee ee 
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(defrule task-branch- 1-start 
2x <- (task (State start)) 
=> 
(retract ?x) 
(assert (task-branches (branch 1)(status try)))) 


(defrule task-branch-2-start 

(declare (salience -10)) 

2x <- (task-branches (branch 1)(status failed)) 
=< 

(retract ?x) 

(assert (task-branches (branch 2)(Status try)))) 


(defrule task-branches-clean-up 
(declare (salience -20)) 
?x <- (task-branches (branch 2)(status failed)) 
=> 
(retract ?x) 
(printout t “No task branch successful!” crif crlf)) 


(defrule task-branch-failure 
(declare (salience -100)) 
?x <- (task-branches (branch ?n)(status try)) 
?y <- (task (state ?)) 


(retract ?x) 


(retract ?y) 
(assert (task-branches (branch ?n)(status failed)))) 
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(defrule task-1-state-homing 
(task-branches (branch 1)(status try)) 
=> 
(assert (task (state homing)))) 


(defrule task-1 -State-drop-package 
(task-branches (branch 1)(status try)) 
?x <- (task (state homing)) 
(test (= (homing) 1)) 

=> 
(retract ?x) 
(assert (task (state drop-package)))) 


(defrule task- 1 -state-get-gps-fix 
(task-branches (branch 1)(status try)) 
?x <- (task (state drop-package)) 
(test (= (drop_package) 1)) 

=> 
(retract ?x) 
(assert (task (state get-gps-fix)))) 


(defrule lask- ]-state-get-next-waypoint 
(task-branches (branch 1)(status try)) 
?x <- (task (state get-gps-fix)) 
(test (= (get_gps_fix) 1)) 

=— 
(retract ?x) 


(assert (task (state get-next-waypoint)))) 


(defrule task-1-state-done 


?x <- (task-branches (branch 1)(status try)) 


?y <- (task (state get-next-waypoint)) 
(test (= (get_next_waypoint) 1)) 


(retract ?x) 
(retract ?y) 
(assert (task (state done)))) 


(defrule task-2-state-surface 
(task-branches (branch 2)(status try)) 
=> 
(assert (task (state surface)))) 


(defrule task-2-state-done 


?x <- (task-branches (branch 2)(Status try)) 


?y <- (task (state surface)) 
=> 
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(retract ?x) 
(retract ?y) 
(surface)) 


: (assert (task (state done)))) —; 1s task done??? 
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(defrule return-branch-1-start 
?x <- (return (state start)) 
=> 
(retract ?x) 
(assert (return-branches (branch 1)(status try)))) 


(defrule return-branch-2-start 
(declare (salience -10)) 
2x <- (return-branches (branch 1)(status failed)) 

=—>> . 

(retract ?x) 

(assert (return-branches (branch 2)(status try)))) 


(defrule return-branches-clean-up 
(declare (salience -20)) 
?x <- (return-branches (branch 2)(status failed)) 
=> 
(retract ?x) 
(printout t “No return branch successful!” crlf crlf)) 


(defrule return-branch-failure 
(declare (salience -100)) 
2x <- (return-branches (branch ?n)(status try)) 
?y <- (return (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (return-branches (branch ?n)(status failed)))) 


(defrule return-1-state-waypoint-control 
(return-branches (branch 1)(status try)) 
= 
(assert (return (state waypoint-control))) 
(assert (Waypoint-control (state start)))) 


(defrule return-1-state-done 
2x <- (return-branches (branch 1 )(status try)) 
?y <- (return (state waypoint-control)) 
22 <- (waypoint-control (state done)) 

=> 


ay 


(retract ?x) 
(retract ?y) 
(retract ?z) 
(assert (return (state done)))) 
2 (assert (mission (state start)))) 


(defrule return-2-state-surface 
(return-branches (branch 2)(status try)) 
=> 
(assert (return (state surface)))) 


(defrule return-2-state-done 
?x <- (return-branches (branch 2)(status try)) 
?y <- (return (state surface)) 
=> 
(retract ?x) 
(retract ?y) 
(surface)) 


‘(assert (return (state done)))) — is return done??? 


(defrule waypoint-control-state-cnt-system-prob 
2x <- (waypoint-conwol (state start)) 
=> 
(retract ?x) 
(assert (waypoint-control (State crit-system-prob))) 
(assert (crit-system-prob (state start)))) 


(defrule waypoint-control-state-get-waypoint-status 
2x <- (waypoint-control (state crit-system-prob)) 
?y <- (crit-system-prob (state not-done)) 
=> 
(retract ?x) 
(retract ?y) 
(assert (waypoint-control (state get-waypoint-status))) 
(assert (get-waypoint-status (State start)))) 


(defrule waypoint-control-state-plan 
2x <- (waypoint-control (state get-waypoint-status)) 
?y <- (get-waypoint-status (state done)) 


(retract ?x) 

(retract ?y) 

(assert (waypoint-control (state plan))) 
(assert (plan (state start)))) 
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(defrule waypoint-control-state-done 
?x <- (waypoint-control (state plan)) 
?y <- (plan (state done)) 


(retract ?x) 

(retract ?y) 
(send_setpoints_and_modes) 

(assert (waypoint-control (state done)))) 
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(defrule get-waypoint-status-branch- ]-start 
2x <- (get-waypoint-status (state start)) 
=> 
(retract ?x) 
(assert (get-waypoint-status-branches (branch 1)(status try)))) 


(defrule get-waypoint-status-branch-2-start 

(declare (salience -10)) 

2x <- (get-waypoint-status-branches (branch 1)(status failed)) 
=> 

(retract ?x) 

(assert (get-waypoint-status-branches (branch 2)(status try)))) 


(defrule get-waypoint-status-branches-clean-up 
(declare (salience -20)) 
2x <- (get-waypoint-status-branches (branch 2)(status failed)) 
=> 
(retract ?x) 
(printout t “No get-waypoint-status branch successful!” crlf crlf)) 


(defrule get-waypoint-status-branch-failure 
(declare (salience -100)) 
2x <- (get-waypoint-status-branches (branch ?n)(status try)) 
?y <- (get-waypoint-status (state ?)) 


(retract 7x) 
(retract ?y) 
(assert (get-waypoint-status-branches (branch ?n)(status failed)))) 


(defrule get-waypoint-status- l-state-gps-check 
(get-waypoint-status-branches (branch 1)(status try)) 
=> 
(assert (get-waypoint-status (state gps-check))) 
(assert (gps-check (state start)))) 


(defrule get-waypoint-status-1-state-reach-waypoint 


ag 


(get-waypoint-status-branches (branch 1)(status try)) 
2x <- (get-waypoint-status (state gps-check)) 
?y <- (gps-check (state done)) 


(retract ?x) 
(retract ?y) 
(assert (get-waypoint-status (state reach-waypoint)))) 


(defrule get-waypoint-status-1-state-done 
2x <- (get-waypoint-status-branches (branch 1)(status try)) 
?y <- (get-waypoint-status (state reach-waypoint)) 
(test (= (reach_waypoint_p) 1)) 


(retract ?x) 

(retract ?y) 

(get_next_waypoint) 

(assert (get-waypoint-status (state done)))) 


(defrule get-waypoint-status-2-state-done 

2x <- (get-waypoint-status-branches (branch 2)(status try)) 
=> 

(retract ?x) 

(assert (get-waypoint-status (state done)))) 
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(defrule gps-check-branch-1-start 
2x <- (gps-check (state start)) 
=> 
(retract ?x) 
(assert (gps-check-branches (branch 1)(status try)))) 


(defrule gps-check-branch-2-start 

(declare (salience -10)) 

2x <- (gps-check-branches (branch 1 )(status failed)) 
=> 

(retract ?x) 

(assert (gps-check-branches (branch 2)(status try)))) 


(defrule gps-check-branches-clean-up 
(declare (salience -20)) 
2x <- (gps-check-branches (branch 2)(status failed)) 
= 
(retract ?x) 
(printout t “No gps-check branch successful!” crlf crlf)) 
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(defrule gps-check-branch-failure 
(declare (salience -100)) 
2x <- (gps-check-branches (branch ?n)(status try)) 
?y <- (gps-check (state ?)) 


=> 
(retract ?x) 
(retract ?y) 
(assert (gps-check-branches (branch ?n)(status failed)))) 
Jor r renee nn nen nn nn nnn nnn e nen n nnn nn nnn nnne nnn nnne- gps-check branch 1-------- 


(defrule gps-check- I -state-gps-needed 
(gps-check-branches (branch 1)(status try)) 
=> 
(assert (gps-check (state gps-needed)))) 


(defrule gps-check- | -state-get-gps-fix 
(gps-check-branches (branch 1)(status try)) 
7x <- (gps-check (state gps-needed)) 

(test (= (gps_needed_p) 1)) 

=> 
(retract ?x) 

(assert (gps-check (state get-gps-fix)))) 


(defrule gps-check-1-state-done 
2x <- (gps-check-branches (branch 1)(status try)) 
?y <- (gps-check (state get-gps-fix)) 
=> 
(retract ?x) 
(retract ?y) 
(get_gps_fix) 
(assert (gps-check (state done)))) 


poorer een n nn nee nee n nen e een n nnn enn nnn e nnn nnnee gps-check branch 2-------- 


(defrule gps-check-2-state-done 

2x <- (gps-check-branches (branch 2)(status try)) 
=> 

(retract ?x) 

(assert (gps-check (state done)))) 


(defrule plan-branch- 1-start 
?x <- (plan (state start)) 
=> 
(retract ?x) 
(assert (plan-branches (branch 1)(status try)))) 
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(defrule plan-branch-2-start 
(declare (salience -10)) 
?x <- (plan-branches (branch 1)(status failed)) 


(retract ?x) 
(assert (plan-branches (branch 2)(status try)))) 


(defrule plan-branch-3-start 
(declare (salience -20)) 
?x <- (plan-branches (branch 2)(status failed)) 


(retract ?x) 
(assert (plan-branches (branch 3)(status try)))) 


(defrule plan-branches-clean-up 
(declare (salience -30)) 
?x <- (plan-branches (branch 3)(status failed)) 


(retract ?x) 
(printout t “No plan branch successful!” crlf crlf)) 


(defrule plan-branch-failure 
(declare (salience -100)) 
?x <- (plan-branches (branch ?n)(status try )) 
?y <- (plan (state ?)) 


=> 

(retract ?x) 

(retract ?y) 

(assert (plan-branches (branch ?n)(status failed)))) 
vane n nnn enn n enn n en nee nnn enn ne nner anne nee nnenneee- plan branch | 


(defrule plan-1-state-red-cap-system-prob 
(plan-branches (branch 1)(status try)) 

=> 
(assert (plan (state red-cap-system-prob))) 
(assert (red-cap-system-prob (State start)))) 


(defrule plan-1-state-global-replan 
(plan-branches (branch 1)(status try)) 
?x <- (plan (state red-cap-system-prob)) 
?y <- (red-cap-system-prob (state done)) 


(retract ?x) 

(retract ?y) 

(assert (plan (state global-replan))) 
(assert (global-replan (state start)))) 


(defrule plan-1-state-done 


?x <- (plan-branches (branch 1)(status try)) 
?y <- (plan (state global-replan)) 
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?z <- (global-replan (state done)) 


(retract ?x) 
(retract ?y) 
(retract 72) 
(assert (plan (state done)))) 


(defrule plan-2-state-near-uncharted-obstacle 
(plan-branches (branch 2)(status try)) 

=> 
(assert (plan (state near-uncharted-obstacle))) 
(assert (near-uncharted-obstacle (state start)))) 


(defrule plan-2-state-local-replan 
(plan-branches (branch 2)(status try)) 
?x <- (plan (state near-uncharted-obstacle)) 
?y <- (near-uncharted-obstacle (state done)) 


(retract ?x) 

(retract ?y) 

(assert (plan (state local-replan))) 
(assert (local-replan (state start)))) 


(defrule plan-2-state-done 
?x <- (plan-branches (branch 2)(status try)) 
?y <- (plan (state local-replan)) 
?z <- (local-replan (state done)) 


(retract ?x) 
(retract ?y) 
(retract ?z) 
(assert (plan (state done)))) 


(defrule plan-3-state-done 

?x <- (plan-branches (branch 3)(status try)) 
=> 

(retract ?x) 

(assert (plan (state done)))) 


(defrule near-uncharted-obstacle-state-unknown-obstacle-p 
(near-uncharted-obstacle (state start)) 

=> 
(assert (near-uncharted-obstacle (state unknown-obstacle-p)))) 
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(defrule near-uncharted-obstacle-state-log-new-obstacle 
?x <- (near-uncharted-obstacle (state unknown-obstacle-p)) 
(test (= (unknown_obstacle_p) 1)) 
=> 
(retract ?x) 
(assert (near-uncharted-obstacle (state log-new-obstacle)))) 


(defrule near-uncharted-obstacle-state-done 

2x <- (near-uncharted-obstacle (state log-new-obstacle)) 
=> 

(log_new_obstacle) 

(retract ?x) 

(assert (near-uncharted-obstacle (state done)))) 


(defrule local-replan-state-loiter 
(local-replan ¢state start)) 

=> 
(assert (local-replan (state loiter)))) 


(defrule local-replan-state-start-local-re planner 
?x <- (local-replan (state loiter)) 
=> 
(loiter) 
(retract ?x) 
(assert (local-replan (state start-local-replanner)))) 


(defrule local-replan-state-done 

2x <- (local-replan (state start-local-replanner)) 
=> 

(start_local_replanner) 

(retract ?x) 

(assert (local-replan (state done)))) 
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(defrule global-replan-state-loiter 
(global-replan (state start)) 

=> 
(assert (global-replan (state loiter)))) 


(defrule global-replan-state-start- global -replanner 
?x <- (global-replan (state loiter)) 
— 
(loiter) 
(retract ?x) 
(assert (global-replan (state start-global-replanner)))) 
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(defrule global-replan-state-done 

?x <- (global-replan (state start-global-replanner)) 
=> 

(start_global_replanner) 

(retract ?x) 

(assert (global-replan (state done)))) 
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(defrule crit-system-prob-branch- 1-start 
?x <- (crit-system-prob (state start)) 
=> 
(retract ?x) 
(assert (crit-system-prob-branches (branch 1)))) 


(defrule crit-system-prob-branch-2-stan 
(declare (salience -10)) 
?x <- (crit-system-prob-branches (branch !)) 
2y <- (crit-svstem-prob (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (crit-system-prob-branches (branch 2)))) 


(defrule crit-system-prob-branch-3-stan 
(declare (salience -20)) 
2x <- (crit-system-prob-branches (branch 2)) 
?y <- (crit-system-prob (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (crit-System-prob-branches (branch 3)))) 


(defrule crit-system-prob-branch-4-stan 
(declare (salience -30)) 
?x <- (crit-system-prob-branches (branch 3)) 
?y <- (crit-system-prob (state 7)) 


(retract ?x) 
(retract ?y) 
(assert (crit-Ssystem-prob-branches (branch 4)))) 


(defrule crit-system-prob-branches-clean-up 
(declare (salience -40)) 
?x <- (crit-system-prob-branches (branch 4)) 
?y <- (crit-system-prob (state ?)) 


(retract ?x) 
(retract ?y) 
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(assert (cnt-system-prob (state not-done))) 
(printout t “No cnt-system-prob branch successful!” crlf crif)) 


Jot terrence ee en nee n ee nn en nnn en eee ce ee nena nen es cnt-system-prob- 1----- 


(defrule crit-system-prob- 1-state-power-gone-p 
(crit-system-prob-branches (branch 1)) 

=> 
(assert (cnt-system-prob (state power-gone-p)))) 


(defrule cnt-system-prob- 1-state-done 
?x <- (cnt-system-prob-branches (branch 1)) 
?y <- (cnt-system-prob (state power-gone-p)) 
(test (= (power_gone_p) 1)) 


=> 
(retract ?x) 
(retract 7y) 
(assert (crit-system-prob (state done)))) 
ooo cnt-system-prob-2----- 


(defrule crit-system-prob-2-state-computer-system-1nop-p 
(cnt-system-prob-branches (branch 2)) 

=> 
(assert (cnt-system-prob (state computer-system-inop-p)))) 


(defrule cnt-system-prob-2-state-done 
?x <- (cmt-system-prob-branches (branch 2)) 
?y <- (cnt-system-prob (state computer-system-inop-p)) 
(test (= (Computer_system_prob_p) 1!)) 


=> 
(retract ?x) 
(retract ?y) 
(assert (cnt-system-prob (state done)))) 
Wore ce tenes eect eee e nce c ee en ene nee n nn nnn nee n nee cnt-system-prob-3----- 


(defrule crit-system-prob-3-state-propulsion-system-p 
(cnt-system-prob-branches (branch 3)) 

=> 
(assert (crit-system-prob (state propulsion-system-p)))) 


(defrule crit-system-prob-3-state-done 
2x <- (cnt-system-prob-branches (branch 3)) 
?y <- (crit-system-prob (state propulsion-system-p)) 
(test (= (propulsion_system_prob_p) 1)) 


(retract ?x) 


(retract ?y) 
(assert (Crit-system-prob (state done)))) 
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Jor erence en coer enn en een enn enone cnet ern ee ee eee ee ee cnit-system-prob-4----- 


(defrule cnt-system-prob-4-state-steering-system -inop-p 
(crit-system-prob-branches (branch 4)) 

=> 
(assert (crit-system-prob (state steering-system-inop-p)))) 


(defrule crit-system-prob-4-state-done 
?x <- (crit-system-prob-branches (branch 4)) 
?y <- (crit-system-prob (state steering-system-inop-p)) 
(test (= (steering_system_prob_p) 1)) 


(retract ?x) 
(retract ?y) 
(assert (crnit-system-prob (state done)))) 


mm ar my mc mc ms ee mm ee ee ee ee ee i es a es ai a 
em a cr rt es cr ec ee we es ae es ee 


(defrule red-cap-system-prob-branch-1-start 
2x <- (red-cap-system-prob (state start)) 
=> 
(retract 7x) 
(assert (red-cap-system-prob-branches (branch 1)))) 


(defrule red-cap-system-prob-branch-2-start 
(declare (salience -10)) 
2x <- (red-cap-system-prob-branches (branch 1)) 
?y <- (red-cap-system-prob (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob-branches (branch 2)))) 


(defrule red-cap-system-prob-branch-3-start 
(declare (salience -20)) 
?x <- (red-cap-system-prob-branches (branch 2)) 
?y <- (red-cap-system-prob (state 7?)) 


(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob-branches (branch 3)))) 


(defrule red-cap-system-prob-branch-4-start 
(declare (salience -30)) 
2x <- (red-cap-system-prob-branches (branch 3)) 
?y <- (red-cap-system-prob (state ?)) 


(retract ?x) 


(retract ?y) 
(assert (red-cap-system-prob-branches (branch 4)))) 
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(defrule red-cap-system-prob-branch-5-start 
(declare (salience -40)) 
?x <- (red-cap-system-prob-branches (branch 4)) 
?y <- (red-cap-system-prob (state ?)) 


(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob-branches (branch 5)))) 


(defrule red-cap-system-prob-branches-clean-up 
(declare (salience -50)) 
?x <- (red-cap-system-prob-branches (branch 5)) 
?y <- (red-cap-system-prob (state ?)) 


=> 

(retract ?x) 

(retract ?y) 

(printout t “No red-cap-system-prob branch successful!” crlf crif)) 
pre rn ene e nnn e nn nn nnn nn nnn nn nn nn nnn nnn nnn ene n ene red-cap-system-prob- | ----- 


(defrule red-cap-system-prob- ]-state-diving-system-p 
(red-cap-system-prob-branches (branch 1)) 

= 
(assert (red-cap-system-prob (state diving-system-p)))) 


(defrule red-cap-system-prob- l-state-done 
2x <- (red-cap-system-prob-branches (branch 1)) 
?y <- (red-cap-system-prob (state diving-system-p)) 
(test (= (diving system_prob_p) 1)) 


=> 
(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob (state done)))) 
So eee eee een eee e renner nnn nnn nnn nnn nnn nnn nnnn ne red-cap-system -prob-2----- 


(defrule red-cap-system-prob-2-state-bouyancy-system-p 
(red-cap-system-prob-branches (branch 2)) 

= 
(assert (red-cap-system-prob (state bouyancy-system-p)))) 


(defrule red-cap-system-prob-2-state-done 
(declare (salience -10)) 
?x <- (red-cap-system-prob-branches (branch 2)) 
?y <- (red-cap-system-prob (state bouyancy-system-p)) 
(test (= (buoyancy_system_prob_p) 1)) 


(retract ?x) 


(retract ?y) 
(assert (red-cap-system-prob (state done)))) 
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Sanna rene nnn nnn nn nen nn nnn nn nen n eee en nn nnn nn nn- = eee red-cap-system-prob-3----- 


(defrule red-cap-system-prob-3-state-thruster-system-p 
(red-cap-system-prob-branches (branch 3)) 

=> 
(assert (red-cap-system-prob (state thruster-system-p)))) 


(defrule red-cap-system -prob-3-state-done 
7x <- (red-cap-system-prob-branches (branch 3)) 
?y <- (red-cap-system-prob (state thruster-system-p)) 
(test (= (thruster_system_prob_p) 1)) 


a 
(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob (state done)))) 
poor ce nnn nnn n nn nn nnn nn nnn nnn noone oo 2 oo === === red-cap-system-prob-4----- 


(defrule red-cap-system-prob-4-state-leak-test-p 
(red-cap-system-prob- branches (branch 4)) 

=> 
(assert (red-cap-system-prob (state leak-test-p)))) 


(defrule red-cap-system-prob-4-state-done 
2x <- (red-cap-system-prob- branches (branch 4)) 
?y <- (red-cap-system-prob (state leak-test-p)) 
(test (= (leak_test_p) 1)) 


(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob (state done)))) 


Soe ee te ne en en nnn nnn nn nnn nn nnn een nnn e er ee eee enneee red-cap-system-prob-5----- 


(defrule red-cap-system-prob-5-state-payload-prob-p 
(red-cap-system-prob-branches (branch 5)) 

=> 
(assert (red-cap-system-prob (state payload-prob-p)))) 


(defrule red-cap-system-prob-5-state-done 
7x <- (red-cap-system-prob-branches (branch 5)) 
Vy <- (red-cap-system-prob (state payload-prob-p)) 
(test (= (payload_prob_p) 1)) 


(retract ?x) 
(retract ?y) 
(assert (red-cap-system-prob (state done)))) 


0 mm ec ec em ee me em cm mm ee ae ese 
ee mm cn ce mm mc me me ee es se ee ae eee ee 
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